{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "mling_model.ipynb",
      "provenance": [],
      "collapsed_sections": []
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4vqepaR4bZzJ"
      },
      "source": [
        "# Inference using multilingual ASR model\n",
        "\n",
        "(Adapted from FAIR's notebook: https://colab.research.google.com/github/facebookresearch/flashlight/blob/master/flashlight/app/asr/tutorial/notebooks/InferenceAndAlignmentCTC.ipynb) "
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "AbTYA-j_vk-7"
      },
      "source": [
        "## Install `Flashlight`\n",
        "First we need to install `Flashlight` and its dependencies. `Flashlight` is installed from source, it takes **~16 minutes**. \n",
        "\n",
        "For installation out of colab notebook please use [link](https://github.com/flashlight/flashlight#building)."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "xNciLYP5zSKf",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "2e5e304a-4497-4c00-e910-f7bc414d2788"
      },
      "source": [
        "# First, choose backend to build with\n",
        "backend = 'CPU' #@param [\"CPU\", \"CUDA\"]\n",
        "# Clone Flashlight\n",
        "!git clone https://github.com/flashlight/flashlight.git\n",
        "# install all dependencies for colab notebook\n",
        "!source flashlight/scripts/colab/colab_install_deps.sh"
      ],
      "execution_count": 2,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Cloning into 'flashlight'...\n",
            "remote: Enumerating objects: 19957, done.\u001b[K\n",
            "remote: Counting objects: 100% (3365/3365), done.\u001b[K\n",
            "remote: Compressing objects: 100% (660/660), done.\u001b[K\n",
            "remote: Total 19957 (delta 2928), reused 2711 (delta 2703), pack-reused 16592\u001b[K\n",
            "Receiving objects: 100% (19957/19957), 14.15 MiB | 18.95 MiB/s, done.\n",
            "Resolving deltas: 100% (14223/14223), done.\n",
            "Reading package lists... Done\n",
            "Building dependency tree       \n",
            "Reading state information... Done\n",
            "libboost-all-dev is already the newest version (1.65.1.0ubuntu1).\n",
            "libopenmpi-dev is already the newest version (2.1.1-8).\n",
            "libsndfile1-dev is already the newest version (1.0.28-4ubuntu0.18.04.2).\n",
            "The following packages were automatically installed and are no longer required:\n",
            "  cuda-command-line-tools-10-0 cuda-command-line-tools-10-1\n",
            "  cuda-command-line-tools-11-0 cuda-compiler-10-0 cuda-compiler-10-1\n",
            "  cuda-compiler-11-0 cuda-cuobjdump-10-0 cuda-cuobjdump-10-1\n",
            "  cuda-cuobjdump-11-0 cuda-cupti-10-0 cuda-cupti-10-1 cuda-cupti-11-0\n",
            "  cuda-cupti-dev-11-0 cuda-documentation-10-0 cuda-documentation-10-1\n",
            "  cuda-documentation-11-0 cuda-documentation-11-1 cuda-gdb-10-0 cuda-gdb-10-1\n",
            "  cuda-gdb-11-0 cuda-gpu-library-advisor-10-0 cuda-gpu-library-advisor-10-1\n",
            "  cuda-libraries-10-0 cuda-libraries-10-1 cuda-libraries-11-0\n",
            "  cuda-memcheck-10-0 cuda-memcheck-10-1 cuda-memcheck-11-0 cuda-nsight-10-0\n",
            "  cuda-nsight-10-1 cuda-nsight-11-0 cuda-nsight-11-1 cuda-nsight-compute-10-0\n",
            "  cuda-nsight-compute-10-1 cuda-nsight-compute-11-0 cuda-nsight-compute-11-1\n",
            "  cuda-nsight-systems-10-1 cuda-nsight-systems-11-0 cuda-nsight-systems-11-1\n",
            "  cuda-nvcc-10-0 cuda-nvcc-10-1 cuda-nvcc-11-0 cuda-nvdisasm-10-0\n",
            "  cuda-nvdisasm-10-1 cuda-nvdisasm-11-0 cuda-nvml-dev-10-0 cuda-nvml-dev-10-1\n",
            "  cuda-nvml-dev-11-0 cuda-nvprof-10-0 cuda-nvprof-10-1 cuda-nvprof-11-0\n",
            "  cuda-nvprune-10-0 cuda-nvprune-10-1 cuda-nvprune-11-0 cuda-nvtx-10-0\n",
            "  cuda-nvtx-10-1 cuda-nvtx-11-0 cuda-nvvp-10-0 cuda-nvvp-10-1 cuda-nvvp-11-0\n",
            "  cuda-nvvp-11-1 cuda-samples-10-0 cuda-samples-10-1 cuda-samples-11-0\n",
            "  cuda-samples-11-1 cuda-sanitizer-11-0 cuda-sanitizer-api-10-1\n",
            "  cuda-toolkit-10-0 cuda-toolkit-10-1 cuda-toolkit-11-0 cuda-toolkit-11-1\n",
            "  cuda-tools-10-0 cuda-tools-10-1 cuda-tools-11-0 cuda-tools-11-1\n",
            "  cuda-visual-tools-10-0 cuda-visual-tools-10-1 cuda-visual-tools-11-0\n",
            "  cuda-visual-tools-11-1 default-jre dkms freeglut3 freeglut3-dev\n",
            "  keyboard-configuration libargon2-0 libcap2 libcryptsetup12\n",
            "  libdevmapper1.02.1 libfontenc1 libidn11 libip4tc0 libjansson4\n",
            "  libnvidia-cfg1-510 libnvidia-common-460 libnvidia-common-510\n",
            "  libnvidia-extra-510 libnvidia-fbc1-510 libnvidia-gl-510 libpam-systemd\n",
            "  libpolkit-agent-1-0 libpolkit-backend-1-0 libpolkit-gobject-1-0 libxfont2\n",
            "  libxi-dev libxkbfile1 libxmu-dev libxmu-headers libxnvctrl0 libxtst6\n",
            "  nsight-compute-2020.2.1 nsight-compute-2022.1.0 nsight-systems-2020.3.2\n",
            "  nsight-systems-2020.3.4 nsight-systems-2021.5.2 nvidia-dkms-510\n",
            "  nvidia-kernel-common-510 nvidia-kernel-source-510 nvidia-modprobe\n",
            "  nvidia-settings openjdk-11-jre policykit-1 policykit-1-gnome python3-xkit\n",
            "  screen-resolution-extra systemd systemd-sysv udev x11-xkb-utils\n",
            "  xserver-common xserver-xorg-core-hwe-18.04 xserver-xorg-video-nvidia-510\n",
            "Use 'sudo apt autoremove' to remove them.\n",
            "The following additional packages will be installed:\n",
            "  libfftw3-bin libfftw3-long3 libfftw3-quad3 libfftw3-single3 libgflags-dev\n",
            "  libgflags2.2 libgoogle-glog0v5\n",
            "Suggested packages:\n",
            "  libfftw3-doc\n",
            "The following NEW packages will be installed:\n",
            "  libfftw3-bin libfftw3-dev libfftw3-long3 libfftw3-quad3 libfftw3-single3\n",
            "  libgflags-dev libgflags2.2 libgoogle-glog-dev libgoogle-glog0v5\n",
            "0 upgraded, 9 newly installed, 0 to remove and 39 not upgraded.\n",
            "Need to get 4,048 kB of archives.\n",
            "After this operation, 22.6 MB of additional disk space will be used.\n",
            "Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfftw3-long3 amd64 3.3.7-1 [308 kB]\n",
            "Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfftw3-quad3 amd64 3.3.7-1 [552 kB]\n",
            "Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfftw3-single3 amd64 3.3.7-1 [764 kB]\n",
            "Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfftw3-bin amd64 3.3.7-1 [32.7 kB]\n",
            "Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfftw3-dev amd64 3.3.7-1 [2,108 kB]\n",
            "Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libgflags2.2 amd64 2.2.1-1 [72.4 kB]\n",
            "Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libgflags-dev amd64 2.2.1-1 [86.1 kB]\n",
            "Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libgoogle-glog0v5 amd64 0.3.5-1 [50.5 kB]\n",
            "Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libgoogle-glog-dev amd64 0.3.5-1 [73.8 kB]\n",
            "Fetched 4,048 kB in 1s (3,279 kB/s)\n",
            "debconf: unable to initialize frontend: Dialog\n",
            "debconf: (No usable dialog-like program is installed, so the dialog based frontend cannot be used. at /usr/share/perl5/Debconf/FrontEnd/Dialog.pm line 76, <> line 9.)\n",
            "debconf: falling back to frontend: Readline\n",
            "debconf: unable to initialize frontend: Readline\n",
            "debconf: (This frontend requires a controlling tty.)\n",
            "debconf: falling back to frontend: Teletype\n",
            "dpkg-preconfigure: unable to re-open stdin: \n",
            "Selecting previously unselected package libfftw3-long3:amd64.\n",
            "(Reading database ... 155113 files and directories currently installed.)\n",
            "Preparing to unpack .../0-libfftw3-long3_3.3.7-1_amd64.deb ...\n",
            "Unpacking libfftw3-long3:amd64 (3.3.7-1) ...\n",
            "Selecting previously unselected package libfftw3-quad3:amd64.\n",
            "Preparing to unpack .../1-libfftw3-quad3_3.3.7-1_amd64.deb ...\n",
            "Unpacking libfftw3-quad3:amd64 (3.3.7-1) ...\n",
            "Selecting previously unselected package libfftw3-single3:amd64.\n",
            "Preparing to unpack .../2-libfftw3-single3_3.3.7-1_amd64.deb ...\n",
            "Unpacking libfftw3-single3:amd64 (3.3.7-1) ...\n",
            "Selecting previously unselected package libfftw3-bin.\n",
            "Preparing to unpack .../3-libfftw3-bin_3.3.7-1_amd64.deb ...\n",
            "Unpacking libfftw3-bin (3.3.7-1) ...\n",
            "Selecting previously unselected package libfftw3-dev:amd64.\n",
            "Preparing to unpack .../4-libfftw3-dev_3.3.7-1_amd64.deb ...\n",
            "Unpacking libfftw3-dev:amd64 (3.3.7-1) ...\n",
            "Selecting previously unselected package libgflags2.2.\n",
            "Preparing to unpack .../5-libgflags2.2_2.2.1-1_amd64.deb ...\n",
            "Unpacking libgflags2.2 (2.2.1-1) ...\n",
            "Selecting previously unselected package libgflags-dev.\n",
            "Preparing to unpack .../6-libgflags-dev_2.2.1-1_amd64.deb ...\n",
            "Unpacking libgflags-dev (2.2.1-1) ...\n",
            "Selecting previously unselected package libgoogle-glog0v5.\n",
            "Preparing to unpack .../7-libgoogle-glog0v5_0.3.5-1_amd64.deb ...\n",
            "Unpacking libgoogle-glog0v5 (0.3.5-1) ...\n",
            "Selecting previously unselected package libgoogle-glog-dev.\n",
            "Preparing to unpack .../8-libgoogle-glog-dev_0.3.5-1_amd64.deb ...\n",
            "Unpacking libgoogle-glog-dev (0.3.5-1) ...\n",
            "Setting up libgflags2.2 (2.2.1-1) ...\n",
            "Setting up libgflags-dev (2.2.1-1) ...\n",
            "Setting up libfftw3-quad3:amd64 (3.3.7-1) ...\n",
            "Setting up libgoogle-glog0v5 (0.3.5-1) ...\n",
            "Setting up libfftw3-single3:amd64 (3.3.7-1) ...\n",
            "Setting up libfftw3-long3:amd64 (3.3.7-1) ...\n",
            "Setting up libfftw3-bin (3.3.7-1) ...\n",
            "Setting up libgoogle-glog-dev (0.3.5-1) ...\n",
            "Setting up libfftw3-dev:amd64 (3.3.7-1) ...\n",
            "Processing triggers for libc-bin (2.27-3ubuntu1.3) ...\n",
            "/sbin/ldconfig.real: /usr/local/lib/python3.7/dist-packages/ideep4py/lib/libmkldnn.so.0 is not a symbolic link\n",
            "\n",
            "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...\n",
            "Cloning into 'kenlm'...\n",
            "remote: Enumerating objects: 14069, done.\u001b[K\n",
            "remote: Counting objects: 100% (382/382), done.\u001b[K\n",
            "remote: Compressing objects: 100% (309/309), done.\u001b[K\n",
            "remote: Total 14069 (delta 115), reused 131 (delta 59), pack-reused 13687\u001b[K\n",
            "Receiving objects: 100% (14069/14069), 5.76 MiB | 11.73 MiB/s, done.\n",
            "Resolving deltas: 100% (7995/7995), done.\n",
            "-- The C compiler identification is GNU 7.5.0\n",
            "-- The CXX compiler identification is GNU 7.5.0\n",
            "-- Check for working C compiler: /usr/bin/cc\n",
            "-- Check for working C compiler: /usr/bin/cc -- works\n",
            "-- Detecting C compiler ABI info\n",
            "-- Detecting C compiler ABI info - done\n",
            "-- Detecting C compile features\n",
            "-- Detecting C compile features - done\n",
            "-- Check for working CXX compiler: /usr/bin/c++\n",
            "-- Check for working CXX compiler: /usr/bin/c++ -- works\n",
            "-- Detecting CXX compiler ABI info\n",
            "-- Detecting CXX compiler ABI info - done\n",
            "-- Detecting CXX compile features\n",
            "-- Detecting CXX compile features - done\n",
            "-- Could NOT find Eigen3 (missing: Eigen3_DIR)\n",
            "-- Looking for pthread.h\n",
            "-- Looking for pthread.h - found\n",
            "-- Looking for pthread_create\n",
            "-- Looking for pthread_create - not found\n",
            "-- Looking for pthread_create in pthreads\n",
            "-- Looking for pthread_create in pthreads - not found\n",
            "-- Looking for pthread_create in pthread\n",
            "-- Looking for pthread_create in pthread - found\n",
            "-- Found Threads: TRUE  \n",
            "-- Boost version: 1.65.1\n",
            "-- Found the following Boost libraries:\n",
            "--   program_options\n",
            "--   system\n",
            "--   thread\n",
            "--   unit_test_framework\n",
            "--   chrono\n",
            "--   date_time\n",
            "--   atomic\n",
            "-- Check if compiler accepts -pthread\n",
            "-- Check if compiler accepts -pthread - yes\n",
            "-- Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version \"1.2.11\") \n",
            "-- Found BZip2: /usr/lib/x86_64-linux-gnu/libbz2.so (found version \"1.0.6\") \n",
            "-- Looking for BZ2_bzCompressInit\n",
            "-- Looking for BZ2_bzCompressInit - found\n",
            "-- Looking for lzma_auto_decoder in /usr/lib/x86_64-linux-gnu/liblzma.so\n",
            "-- Looking for lzma_auto_decoder in /usr/lib/x86_64-linux-gnu/liblzma.so - found\n",
            "-- Looking for lzma_easy_encoder in /usr/lib/x86_64-linux-gnu/liblzma.so\n",
            "-- Looking for lzma_easy_encoder in /usr/lib/x86_64-linux-gnu/liblzma.so - found\n",
            "-- Looking for lzma_lzma_preset in /usr/lib/x86_64-linux-gnu/liblzma.so\n",
            "-- Looking for lzma_lzma_preset in /usr/lib/x86_64-linux-gnu/liblzma.so - found\n",
            "-- Found LibLZMA: /usr/include (found version \"5.2.2\") \n",
            "-- Looking for clock_gettime in rt\n",
            "-- Looking for clock_gettime in rt - found\n",
            "-- Configuring done\n",
            "-- Generating done\n",
            "-- Build files have been written to: /tmp/kenlm/build\n",
            "\u001b[35m\u001b[1mScanning dependencies of target kenlm_util\u001b[0m\n",
            "[  2%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/bignum.cc.o\u001b[0m\n",
            "[  2%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/bignum-dtoa.cc.o\u001b[0m\n",
            "[  3%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/cached-powers.cc.o\u001b[0m\n",
            "[  5%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/diy-fp.cc.o\u001b[0m\n",
            "[  6%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/double-conversion.cc.o\u001b[0m\n",
            "[  7%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/fast-dtoa.cc.o\u001b[0m\n",
            "[  8%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/fixed-dtoa.cc.o\u001b[0m\n",
            "[ 10%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/double-conversion/strtod.cc.o\u001b[0m\n",
            "[ 11%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/stream/chain.cc.o\u001b[0m\n",
            "[ 12%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/stream/count_records.cc.o\u001b[0m\n",
            "[ 13%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/stream/io.cc.o\u001b[0m\n",
            "[ 15%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/stream/line_input.cc.o\u001b[0m\n",
            "[ 16%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/stream/multi_progress.cc.o\u001b[0m\n",
            "[ 17%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/stream/rewindable_stream.cc.o\u001b[0m\n",
            "[ 18%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/bit_packing.cc.o\u001b[0m\n",
            "[ 20%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/ersatz_progress.cc.o\u001b[0m\n",
            "[ 21%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/exception.cc.o\u001b[0m\n",
            "[ 22%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/file.cc.o\u001b[0m\n",
            "[ 23%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/file_piece.cc.o\u001b[0m\n",
            "[ 25%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/float_to_string.cc.o\u001b[0m\n",
            "[ 26%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/integer_to_string.cc.o\u001b[0m\n",
            "[ 27%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/mmap.cc.o\u001b[0m\n",
            "[ 28%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/murmur_hash.cc.o\u001b[0m\n",
            "[ 30%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/parallel_read.cc.o\u001b[0m\n",
            "[ 31%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/pool.cc.o\u001b[0m\n",
            "[ 32%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/read_compressed.cc.o\u001b[0m\n",
            "[ 33%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/scoped.cc.o\u001b[0m\n",
            "[ 35%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/spaces.cc.o\u001b[0m\n",
            "[ 36%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/string_piece.cc.o\u001b[0m\n",
            "[ 37%] \u001b[32mBuilding CXX object util/CMakeFiles/kenlm_util.dir/usage.cc.o\u001b[0m\n",
            "[ 38%] \u001b[32m\u001b[1mLinking CXX static library ../lib/libkenlm_util.a\u001b[0m\n",
            "[ 38%] Built target kenlm_util\n",
            "\u001b[35m\u001b[1mScanning dependencies of target probing_hash_table_benchmark\u001b[0m\n",
            "\u001b[35m\u001b[1mScanning dependencies of target kenlm\u001b[0m\n",
            "[ 40%] \u001b[32mBuilding CXX object util/CMakeFiles/probing_hash_table_benchmark.dir/probing_hash_table_benchmark_main.cc.o\u001b[0m\n",
            "[ 41%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/bhiksha.cc.o\u001b[0m\n",
            "[ 42%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/binary_format.cc.o\u001b[0m\n",
            "[ 43%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/config.cc.o\u001b[0m\n",
            "[ 45%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/lm_exception.cc.o\u001b[0m\n",
            "[ 46%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/model.cc.o\u001b[0m\n",
            "[ 47%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/quantize.cc.o\u001b[0m\n",
            "[ 48%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/read_arpa.cc.o\u001b[0m\n",
            "[ 50%] \u001b[32m\u001b[1mLinking CXX executable ../bin/probing_hash_table_benchmark\u001b[0m\n",
            "[ 50%] Built target probing_hash_table_benchmark\n",
            "\u001b[35m\u001b[1mScanning dependencies of target kenlm_filter\u001b[0m\n",
            "[ 51%] \u001b[32mBuilding CXX object lm/filter/CMakeFiles/kenlm_filter.dir/arpa_io.cc.o\u001b[0m\n",
            "[ 52%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/search_hashed.cc.o\u001b[0m\n",
            "[ 53%] \u001b[32mBuilding CXX object lm/filter/CMakeFiles/kenlm_filter.dir/phrase.cc.o\u001b[0m\n",
            "[ 55%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/search_trie.cc.o\u001b[0m\n",
            "[ 56%] \u001b[32mBuilding CXX object lm/filter/CMakeFiles/kenlm_filter.dir/vocab.cc.o\u001b[0m\n",
            "[ 57%] \u001b[32m\u001b[1mLinking CXX static library ../../lib/libkenlm_filter.a\u001b[0m\n",
            "[ 57%] Built target kenlm_filter\n",
            "[ 58%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/sizes.cc.o\u001b[0m\n",
            "[ 60%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/trie.cc.o\u001b[0m\n",
            "[ 61%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/trie_sort.cc.o\u001b[0m\n",
            "[ 62%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/value_build.cc.o\u001b[0m\n",
            "[ 63%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/virtual_interface.cc.o\u001b[0m\n",
            "[ 65%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/vocab.cc.o\u001b[0m\n",
            "[ 66%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/common/model_buffer.cc.o\u001b[0m\n",
            "[ 67%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/common/print.cc.o\u001b[0m\n",
            "[ 68%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/common/renumber.cc.o\u001b[0m\n",
            "[ 70%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm.dir/common/size_option.cc.o\u001b[0m\n",
            "[ 71%] \u001b[32m\u001b[1mLinking CXX static library ../lib/libkenlm.a\u001b[0m\n",
            "[ 71%] Built target kenlm\n",
            "\u001b[35m\u001b[1mScanning dependencies of target build_binary\u001b[0m\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fragment\u001b[0m\n",
            "[ 72%] \u001b[32mBuilding CXX object lm/CMakeFiles/fragment.dir/fragment_main.cc.o\u001b[0m\n",
            "[ 73%] \u001b[32mBuilding CXX object lm/CMakeFiles/build_binary.dir/build_binary_main.cc.o\u001b[0m\n",
            "[ 75%] \u001b[32m\u001b[1mLinking CXX executable ../bin/fragment\u001b[0m\n",
            "[ 75%] Built target fragment\n",
            "\u001b[35m\u001b[1mScanning dependencies of target kenlm_benchmark\u001b[0m\n",
            "[ 76%] \u001b[32m\u001b[1mLinking CXX executable ../bin/build_binary\u001b[0m\n",
            "[ 77%] \u001b[32mBuilding CXX object lm/CMakeFiles/kenlm_benchmark.dir/kenlm_benchmark_main.cc.o\u001b[0m\n",
            "[ 77%] Built target build_binary\n",
            "\u001b[35m\u001b[1mScanning dependencies of target query\u001b[0m\n",
            "[ 78%] \u001b[32mBuilding CXX object lm/CMakeFiles/query.dir/query_main.cc.o\u001b[0m\n",
            "[ 80%] \u001b[32m\u001b[1mLinking CXX executable ../bin/query\u001b[0m\n",
            "[ 80%] Built target query\n",
            "\u001b[35m\u001b[1mScanning dependencies of target kenlm_builder\u001b[0m\n",
            "[ 81%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/kenlm_builder.dir/adjust_counts.cc.o\u001b[0m\n",
            "[ 82%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/kenlm_builder.dir/corpus_count.cc.o\u001b[0m\n",
            "[ 83%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/kenlm_builder.dir/initial_probabilities.cc.o\u001b[0m\n",
            "[ 85%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/kenlm_builder.dir/interpolate.cc.o\u001b[0m\n",
            "[ 86%] \u001b[32m\u001b[1mLinking CXX executable ../bin/kenlm_benchmark\u001b[0m\n",
            "[ 86%] Built target kenlm_benchmark\n",
            "[ 87%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/kenlm_builder.dir/output.cc.o\u001b[0m\n",
            "\u001b[35m\u001b[1mScanning dependencies of target phrase_table_vocab\u001b[0m\n",
            "[ 88%] \u001b[32mBuilding CXX object lm/filter/CMakeFiles/phrase_table_vocab.dir/phrase_table_vocab_main.cc.o\u001b[0m\n",
            "[ 90%] \u001b[32m\u001b[1mLinking CXX executable ../../bin/phrase_table_vocab\u001b[0m\n",
            "[ 90%] Built target phrase_table_vocab\n",
            "\u001b[35m\u001b[1mScanning dependencies of target filter\u001b[0m\n",
            "[ 91%] \u001b[32mBuilding CXX object lm/filter/CMakeFiles/filter.dir/filter_main.cc.o\u001b[0m\n",
            "[ 92%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/kenlm_builder.dir/pipeline.cc.o\u001b[0m\n",
            "[ 93%] \u001b[32m\u001b[1mLinking CXX static library ../../lib/libkenlm_builder.a\u001b[0m\n",
            "[ 93%] Built target kenlm_builder\n",
            "\u001b[35m\u001b[1mScanning dependencies of target count_ngrams\u001b[0m\n",
            "[ 95%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/count_ngrams.dir/count_ngrams_main.cc.o\u001b[0m\n",
            "[ 96%] \u001b[32m\u001b[1mLinking CXX executable ../../bin/filter\u001b[0m\n",
            "[ 96%] Built target filter\n",
            "\u001b[35m\u001b[1mScanning dependencies of target lmplz\u001b[0m\n",
            "[ 97%] \u001b[32mBuilding CXX object lm/builder/CMakeFiles/lmplz.dir/lmplz_main.cc.o\u001b[0m\n",
            "[ 98%] \u001b[32m\u001b[1mLinking CXX executable ../../bin/count_ngrams\u001b[0m\n",
            "[ 98%] Built target count_ngrams\n",
            "[100%] \u001b[32m\u001b[1mLinking CXX executable ../../bin/lmplz\u001b[0m\n",
            "[100%] Built target lmplz\n",
            "\u001b[36mInstall the project...\u001b[0m\n",
            "-- Install configuration: \"Release\"\n",
            "-- Installing: /usr/local/share/kenlm/cmake/kenlmTargets.cmake\n",
            "-- Installing: /usr/local/share/kenlm/cmake/kenlmTargets-release.cmake\n",
            "-- Installing: /usr/local/include/kenlm/util/bit_packing.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/ersatz_progress.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/exception.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/fake_ostream.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/file.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/file_piece.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/file_stream.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/fixed_array.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/float_to_string.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/getopt.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/have.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/integer_to_string.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/joint_sort.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/mmap.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/multi_intersection.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/murmur_hash.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/parallel_read.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/pcqueue.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/pool.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/probing_hash_table.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/proxy_iterator.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/read_compressed.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/scoped.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/sized_iterator.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/sorted_uniform.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/spaces.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/string_piece.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/string_piece_hash.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/string_stream.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/thread_pool.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/tokenize_piece.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/usage.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/bignum-dtoa.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/bignum.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/cached-powers.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/diy-fp.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/double-conversion.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/fast-dtoa.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/fixed-dtoa.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/ieee.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/strtod.h\n",
            "-- Installing: /usr/local/include/kenlm/util/double-conversion/utils.h\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/block.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/chain.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/config.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/count_records.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/io.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/line_input.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/multi_progress.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/multi_stream.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/rewindable_stream.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/sort.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/stream.hh\n",
            "-- Installing: /usr/local/include/kenlm/util/stream/typed_stream.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/bhiksha.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/binary_format.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/blank.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/config.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/enumerate_vocab.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/facade.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/left.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/lm_exception.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/max_order.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/model.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/model_type.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/ngram_query.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/partial.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/quantize.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/read_arpa.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/return.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/search_hashed.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/search_trie.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/sizes.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/state.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/trie.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/trie_sort.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/value.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/value_build.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/virtual_interface.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/vocab.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/weights.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/word_index.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/adjust_counts.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/combine_counts.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/corpus_count.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/debug_print.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/discount.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/hash_gamma.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/header_info.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/initial_probabilities.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/interpolate.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/output.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/payload.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/builder/pipeline.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/compare.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/joint_order.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/model_buffer.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/ngram.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/ngram_stream.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/print.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/renumber.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/size_option.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/common/special.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/filter/arpa_io.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/filter/count_io.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/filter/format.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/filter/phrase.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/filter/thread.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/filter/vocab.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/filter/wrapper.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/backoff_matrix.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/backoff_reunification.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/bounded_sequence_encoding.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/interpolate_info.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/merge_probabilities.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/merge_vocab.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/normalize.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/pipeline.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/split_worker.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/tune_derivatives.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/tune_instances.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/tune_matrix.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/tune_weights.hh\n",
            "-- Installing: /usr/local/include/kenlm/lm/interpolate/universal_vocab.hh\n",
            "-- Installing: /usr/local/share/kenlm/cmake/kenlmConfig.cmake\n",
            "-- Installing: /usr/local/lib/libkenlm_util.a\n",
            "-- Installing: /usr/local/bin/probing_hash_table_benchmark\n",
            "-- Installing: /usr/local/lib/libkenlm.a\n",
            "-- Installing: /usr/local/bin/query\n",
            "-- Installing: /usr/local/bin/fragment\n",
            "-- Installing: /usr/local/bin/build_binary\n",
            "-- Installing: /usr/local/bin/kenlm_benchmark\n",
            "-- Installing: /usr/local/bin/lmplz\n",
            "-- Installing: /usr/local/bin/count_ngrams\n",
            "-- Installing: /usr/local/lib/libkenlm_builder.a\n",
            "-- Installing: /usr/local/bin/filter\n",
            "-- Installing: /usr/local/bin/phrase_table_vocab\n",
            "-- Installing: /usr/local/lib/libkenlm_filter.a\n",
            "--2022-02-21 14:41:35--  https://arrayfire.s3.amazonaws.com/3.7.1/ArrayFire-v3.7.1-1_Linux_x86_64.sh\n",
            "Resolving arrayfire.s3.amazonaws.com (arrayfire.s3.amazonaws.com)... 52.217.45.244\n",
            "Connecting to arrayfire.s3.amazonaws.com (arrayfire.s3.amazonaws.com)|52.217.45.244|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 1189949434 (1.1G) [application/x-shellscript]\n",
            "Saving to: ‘ArrayFire-v3.7.1-1_Linux_x86_64.sh’\n",
            "\n",
            "ArrayFire-v3.7.1-1_ 100%[===================>]   1.11G  56.9MB/s    in 18s     \n",
            "\n",
            "2022-02-21 14:41:53 (62.5 MB/s) - ‘ArrayFire-v3.7.1-1_Linux_x86_64.sh’ saved [1189949434/1189949434]\n",
            "\n",
            "ArrayFire Installer Version: 3.7.1, Copyright (c) ArrayFire\n",
            "This is a self-extracting archive.\n",
            "The archive will be extracted to: /opt/arrayfire\n",
            "\n",
            "Using target directory: /opt/arrayfire\n",
            "Extracting, please wait...\n",
            "\n",
            "Unpacking finished successfully\n",
            "--2022-02-21 14:42:34--  https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB\n",
            "Resolving apt.repos.intel.com (apt.repos.intel.com)... 23.192.87.240, 2600:1402:3800:2ab::4b23, 2600:1402:3800:2aa::4b23\n",
            "Connecting to apt.repos.intel.com (apt.repos.intel.com)|23.192.87.240|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 1914 (1.9K) [binary/octet-stream]\n",
            "Saving to: ‘GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB’\n",
            "\n",
            "GPG-PUB-KEY-INTEL-S 100%[===================>]   1.87K  --.-KB/s    in 0s      \n",
            "\n",
            "2022-02-21 14:42:34 (290 MB/s) - ‘GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB’ saved [1914/1914]\n",
            "\n",
            "OK\n",
            "Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]\n",
            "Get:2 https://apt.repos.intel.com/mkl all InRelease [4,438 B]\n",
            "Ign:3 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease\n",
            "Get:4 https://cloud.r-project.org/bin/linux/ubuntu bionic-cran40/ InRelease [3,626 B]\n",
            "Get:5 http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic InRelease [15.9 kB]\n",
            "Ign:6 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  InRelease\n",
            "Get:7 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  Release [696 B]\n",
            "Hit:8 http://archive.ubuntu.com/ubuntu bionic InRelease\n",
            "Hit:9 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Release\n",
            "Get:10 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  Release.gpg [836 B]\n",
            "Get:11 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]\n",
            "Get:12 https://apt.repos.intel.com/mkl all/main all Packages [35.0 kB]\n",
            "Get:13 https://apt.repos.intel.com/mkl all/main amd64 Packages [140 kB]\n",
            "Hit:14 http://ppa.launchpad.net/cran/libgit2/ubuntu bionic InRelease\n",
            "Get:15 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [783 kB]\n",
            "Get:16 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease [15.9 kB]\n",
            "Get:17 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]\n",
            "Get:18 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,470 kB]\n",
            "Get:19 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [21.1 kB]\n",
            "Get:20 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,564 kB]\n",
            "Get:21 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic InRelease [21.3 kB]\n",
            "Get:23 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  Packages [917 kB]\n",
            "Get:24 http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic/main Sources [1,827 kB]\n",
            "Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [29.0 kB]\n",
            "Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3,004 kB]\n",
            "Get:27 http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic/main amd64 Packages [937 kB]\n",
            "Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2,248 kB]\n",
            "Get:29 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [816 kB]\n",
            "Get:30 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main amd64 Packages [45.3 kB]\n",
            "Get:31 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic/main amd64 Packages [42.8 kB]\n",
            "Fetched 15.2 MB in 5s (3,283 kB/s)\n",
            "Reading package lists... Done\n",
            "Reading package lists... Done\n",
            "Building dependency tree       \n",
            "Reading state information... Done\n",
            "The following packages were automatically installed and are no longer required:\n",
            "  cuda-command-line-tools-10-0 cuda-command-line-tools-10-1\n",
            "  cuda-command-line-tools-11-0 cuda-compiler-10-0 cuda-compiler-10-1\n",
            "  cuda-compiler-11-0 cuda-cuobjdump-10-0 cuda-cuobjdump-10-1\n",
            "  cuda-cuobjdump-11-0 cuda-cupti-10-0 cuda-cupti-10-1 cuda-cupti-11-0\n",
            "  cuda-cupti-dev-11-0 cuda-documentation-10-0 cuda-documentation-10-1\n",
            "  cuda-documentation-11-0 cuda-documentation-11-1 cuda-gdb-10-0 cuda-gdb-10-1\n",
            "  cuda-gdb-11-0 cuda-gpu-library-advisor-10-0 cuda-gpu-library-advisor-10-1\n",
            "  cuda-libraries-10-0 cuda-libraries-10-1 cuda-libraries-11-0\n",
            "  cuda-memcheck-10-0 cuda-memcheck-10-1 cuda-memcheck-11-0 cuda-nsight-10-0\n",
            "  cuda-nsight-10-1 cuda-nsight-11-0 cuda-nsight-11-1 cuda-nsight-compute-10-0\n",
            "  cuda-nsight-compute-10-1 cuda-nsight-compute-11-0 cuda-nsight-compute-11-1\n",
            "  cuda-nsight-systems-10-1 cuda-nsight-systems-11-0 cuda-nsight-systems-11-1\n",
            "  cuda-nvcc-10-0 cuda-nvcc-10-1 cuda-nvcc-11-0 cuda-nvdisasm-10-0\n",
            "  cuda-nvdisasm-10-1 cuda-nvdisasm-11-0 cuda-nvml-dev-10-0 cuda-nvml-dev-10-1\n",
            "  cuda-nvml-dev-11-0 cuda-nvprof-10-0 cuda-nvprof-10-1 cuda-nvprof-11-0\n",
            "  cuda-nvprune-10-0 cuda-nvprune-10-1 cuda-nvprune-11-0 cuda-nvtx-10-0\n",
            "  cuda-nvtx-10-1 cuda-nvtx-11-0 cuda-nvvp-10-0 cuda-nvvp-10-1 cuda-nvvp-11-0\n",
            "  cuda-nvvp-11-1 cuda-samples-10-0 cuda-samples-10-1 cuda-samples-11-0\n",
            "  cuda-samples-11-1 cuda-sanitizer-11-0 cuda-sanitizer-api-10-1\n",
            "  cuda-toolkit-10-0 cuda-toolkit-10-1 cuda-toolkit-11-0 cuda-toolkit-11-1\n",
            "  cuda-tools-10-0 cuda-tools-10-1 cuda-tools-11-0 cuda-tools-11-1\n",
            "  cuda-visual-tools-10-0 cuda-visual-tools-10-1 cuda-visual-tools-11-0\n",
            "  cuda-visual-tools-11-1 default-jre dkms freeglut3 freeglut3-dev\n",
            "  keyboard-configuration libargon2-0 libcap2 libcryptsetup12\n",
            "  libdevmapper1.02.1 libfontenc1 libidn11 libip4tc0 libjansson4\n",
            "  libnvidia-cfg1-510 libnvidia-common-460 libnvidia-common-510\n",
            "  libnvidia-extra-510 libnvidia-fbc1-510 libnvidia-gl-510 libpam-systemd\n",
            "  libpolkit-agent-1-0 libpolkit-backend-1-0 libpolkit-gobject-1-0 libxfont2\n",
            "  libxi-dev libxkbfile1 libxmu-dev libxmu-headers libxnvctrl0 libxtst6\n",
            "  nsight-compute-2020.2.1 nsight-compute-2022.1.0 nsight-systems-2020.3.2\n",
            "  nsight-systems-2020.3.4 nsight-systems-2021.5.2 nvidia-dkms-510\n",
            "  nvidia-kernel-common-510 nvidia-kernel-source-510 nvidia-modprobe\n",
            "  nvidia-settings openjdk-11-jre policykit-1 policykit-1-gnome python3-xkit\n",
            "  screen-resolution-extra systemd systemd-sysv udev x11-xkb-utils\n",
            "  xserver-common xserver-xorg-core-hwe-18.04 xserver-xorg-video-nvidia-510\n",
            "Use 'apt autoremove' to remove them.\n",
            "The following additional packages will be installed:\n",
            "  intel-comp-l-all-vars-19.1.0-166 intel-comp-nomcu-vars-19.1.0-166\n",
            "  intel-conda-index-tool-19.1.0-166\n",
            "  intel-conda-intel-openmp-linux-64-shadow-package-19.1.0-166\n",
            "  intel-conda-mkl-devel-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-mkl-include-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-mkl-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-mkl-static-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-tbb-linux-64-shadow-package-2020.0-166\n",
            "  intel-mkl-cluster-2020.0-166 intel-mkl-cluster-c-2020.0-166\n",
            "  intel-mkl-cluster-f-2020.0-166 intel-mkl-cluster-rt-2020.0-166\n",
            "  intel-mkl-common-2020.0-166 intel-mkl-common-c-2020.0-166\n",
            "  intel-mkl-common-c-ps-2020.0-166 intel-mkl-common-f-2020.0-166\n",
            "  intel-mkl-common-ps-2020.0-166 intel-mkl-core-2020.0-166\n",
            "  intel-mkl-core-c-2020.0-166 intel-mkl-core-f-2020.0-166\n",
            "  intel-mkl-core-ps-2020.0-166 intel-mkl-core-rt-2020.0-166 intel-mkl-doc-2020\n",
            "  intel-mkl-doc-ps-2020 intel-mkl-f95-2020.0-166\n",
            "  intel-mkl-f95-common-2020.0-166 intel-mkl-gnu-2020.0-166\n",
            "  intel-mkl-gnu-c-2020.0-166 intel-mkl-gnu-f-2020.0-166\n",
            "  intel-mkl-gnu-f-rt-2020.0-166 intel-mkl-gnu-rt-2020.0-166\n",
            "  intel-mkl-pgi-2020.0-166 intel-mkl-pgi-c-2020.0-166\n",
            "  intel-mkl-pgi-rt-2020.0-166 intel-mkl-psxe-2020.0-088\n",
            "  intel-mkl-tbb-2020.0-166 intel-mkl-tbb-rt-2020.0-166 intel-openmp-19.1.0-166\n",
            "  intel-psxe-common-2020.0-088 intel-psxe-common-doc-2020\n",
            "  intel-tbb-libs-2020.0-166\n",
            "The following NEW packages will be installed:\n",
            "  intel-comp-l-all-vars-19.1.0-166 intel-comp-nomcu-vars-19.1.0-166\n",
            "  intel-conda-index-tool-19.1.0-166\n",
            "  intel-conda-intel-openmp-linux-64-shadow-package-19.1.0-166\n",
            "  intel-conda-mkl-devel-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-mkl-include-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-mkl-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-mkl-static-linux-64-shadow-package-2020.0-166\n",
            "  intel-conda-tbb-linux-64-shadow-package-2020.0-166\n",
            "  intel-mkl-64bit-2020.0-088 intel-mkl-cluster-2020.0-166\n",
            "  intel-mkl-cluster-c-2020.0-166 intel-mkl-cluster-f-2020.0-166\n",
            "  intel-mkl-cluster-rt-2020.0-166 intel-mkl-common-2020.0-166\n",
            "  intel-mkl-common-c-2020.0-166 intel-mkl-common-c-ps-2020.0-166\n",
            "  intel-mkl-common-f-2020.0-166 intel-mkl-common-ps-2020.0-166\n",
            "  intel-mkl-core-2020.0-166 intel-mkl-core-c-2020.0-166\n",
            "  intel-mkl-core-f-2020.0-166 intel-mkl-core-ps-2020.0-166\n",
            "  intel-mkl-core-rt-2020.0-166 intel-mkl-doc-2020 intel-mkl-doc-ps-2020\n",
            "  intel-mkl-f95-2020.0-166 intel-mkl-f95-common-2020.0-166\n",
            "  intel-mkl-gnu-2020.0-166 intel-mkl-gnu-c-2020.0-166\n",
            "  intel-mkl-gnu-f-2020.0-166 intel-mkl-gnu-f-rt-2020.0-166\n",
            "  intel-mkl-gnu-rt-2020.0-166 intel-mkl-pgi-2020.0-166\n",
            "  intel-mkl-pgi-c-2020.0-166 intel-mkl-pgi-rt-2020.0-166\n",
            "  intel-mkl-psxe-2020.0-088 intel-mkl-tbb-2020.0-166\n",
            "  intel-mkl-tbb-rt-2020.0-166 intel-openmp-19.1.0-166\n",
            "  intel-psxe-common-2020.0-088 intel-psxe-common-doc-2020\n",
            "  intel-tbb-libs-2020.0-166\n",
            "0 upgraded, 43 newly installed, 0 to remove and 71 not upgraded.\n",
            "Need to get 300 MB of archives.\n",
            "After this operation, 0 B of additional disk space will be used.\n",
            "Get:1 https://apt.repos.intel.com/mkl all/main amd64 intel-comp-l-all-vars-19.1.0-166 all 19.1.0-166 [9,348 B]\n",
            "Get:2 https://apt.repos.intel.com/mkl all/main amd64 intel-comp-nomcu-vars-19.1.0-166 all 19.1.0-166 [5,754 B]\n",
            "Get:3 https://apt.repos.intel.com/mkl all/main amd64 intel-conda-index-tool-19.1.0-166 amd64 19.1.0-166 [15.1 MB]\n",
            "Get:4 https://apt.repos.intel.com/mkl all/main amd64 intel-conda-intel-openmp-linux-64-shadow-package-19.1.0-166 amd64 19.1.0-166 [8,146 B]\n",
            "Get:5 https://apt.repos.intel.com/mkl all/main amd64 intel-tbb-libs-2020.0-166 amd64 2020.0-166 [645 kB]\n",
            "Get:6 https://apt.repos.intel.com/mkl all/main amd64 intel-conda-tbb-linux-64-shadow-package-2020.0-166 amd64 2020.0-166 [8,238 B]\n",
            "Get:7 https://apt.repos.intel.com/mkl all/main amd64 intel-openmp-19.1.0-166 amd64 19.1.0-166 [1,810 kB]\n",
            "Get:8 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-doc-2020 all 2020.4-304 [12.6 kB]\n",
            "Get:9 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-common-2020.0-166 all 2020.0-166 [93.0 kB]\n",
            "Get:10 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-core-rt-2020.0-166 amd64 2020.0-166 [126 MB]\n",
            "Get:11 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-core-2020.0-166 amd64 2020.0-166 [106 MB]\n",
            "Get:12 https://apt.repos.intel.com/mkl all/main amd64 intel-conda-mkl-linux-64-shadow-package-2020.0-166 amd64 2020.0-166 [8,614 B]\n",
            "Get:13 https://apt.repos.intel.com/mkl all/main amd64 intel-conda-mkl-include-linux-64-shadow-package-2020.0-166 amd64 2020.0-166 [9,042 B]\n",
            "Get:14 https://apt.repos.intel.com/mkl all/main amd64 intel-conda-mkl-devel-linux-64-shadow-package-2020.0-166 amd64 2020.0-166 [8,108 B]\n",
            "Get:15 https://apt.repos.intel.com/mkl all/main amd64 intel-conda-mkl-static-linux-64-shadow-package-2020.0-166 amd64 2020.0-166 [8,510 B]\n",
            "Get:16 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-cluster-rt-2020.0-166 amd64 2020.0-166 [4,005 kB]\n",
            "Get:17 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-cluster-2020.0-166 amd64 2020.0-166 [4,009 kB]\n",
            "Get:18 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-common-c-2020.0-166 all 2020.0-166 [1,794 kB]\n",
            "Get:19 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-cluster-c-2020.0-166 all 2020.0-166 [1,640 B]\n",
            "Get:20 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-common-f-2020.0-166 all 2020.0-166 [1,630 kB]\n",
            "Get:21 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-cluster-f-2020.0-166 all 2020.0-166 [1,640 B]\n",
            "Get:22 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-common-ps-2020.0-166 all 2020.0-166 [60.5 kB]\n",
            "Get:23 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-doc-ps-2020 all 2020.4-304 [69.3 kB]\n",
            "Get:24 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-common-c-ps-2020.0-166 all 2020.0-166 [26.9 kB]\n",
            "Get:25 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-core-c-2020.0-166 amd64 2020.0-166 [1,640 B]\n",
            "Get:26 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-core-f-2020.0-166 amd64 2020.0-166 [1,640 B]\n",
            "Get:27 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-core-ps-2020.0-166 amd64 2020.0-166 [6,353 kB]\n",
            "Get:28 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-f95-common-2020.0-166 all 2020.0-166 [131 kB]\n",
            "Get:29 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-f95-2020.0-166 amd64 2020.0-166 [1,768 kB]\n",
            "Get:30 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-gnu-rt-2020.0-166 amd64 2020.0-166 [3,879 kB]\n",
            "Get:31 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-gnu-2020.0-166 amd64 2020.0-166 [3,446 kB]\n",
            "Get:32 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-gnu-c-2020.0-166 amd64 2020.0-166 [1,640 B]\n",
            "Get:33 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-gnu-f-rt-2020.0-166 amd64 2020.0-166 [2,838 kB]\n",
            "Get:34 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-gnu-f-2020.0-166 amd64 2020.0-166 [1,440 kB]\n",
            "Get:35 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-pgi-rt-2020.0-166 amd64 2020.0-166 [5,213 kB]\n",
            "Get:36 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-pgi-2020.0-166 amd64 2020.0-166 [4,914 kB]\n",
            "Get:37 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-pgi-c-2020.0-166 amd64 2020.0-166 [1,642 B]\n",
            "Get:38 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-psxe-2020.0-088 all 2020.0-088 [2,056 B]\n",
            "Get:39 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-tbb-rt-2020.0-166 amd64 2020.0-166 [4,638 kB]\n",
            "Get:40 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-tbb-2020.0-166 amd64 2020.0-166 [4,244 kB]\n",
            "Get:41 https://apt.repos.intel.com/mkl all/main amd64 intel-psxe-common-doc-2020 all 2020.1-102 [5,904 B]\n",
            "Get:42 https://apt.repos.intel.com/mkl all/main amd64 intel-psxe-common-2020.0-088 all 2020.0-088 [4,948 B]\n",
            "Get:43 https://apt.repos.intel.com/mkl all/main amd64 intel-mkl-64bit-2020.0-088 amd64 2020.0-088 [2,148 B]\n",
            "Fetched 300 MB in 5s (66.4 MB/s)\n",
            "Extracting templates from packages: 100%\n",
            "Selecting previously unselected package intel-comp-l-all-vars-19.1.0-166.\n",
            "(Reading database ... 155247 files and directories currently installed.)\n",
            "Preparing to unpack .../00-intel-comp-l-all-vars-19.1.0-166_19.1.0-166_all.deb ...\n",
            "Unpacking intel-comp-l-all-vars-19.1.0-166 (19.1.0-166) ...\n",
            "Selecting previously unselected package intel-comp-nomcu-vars-19.1.0-166.\n",
            "Preparing to unpack .../01-intel-comp-nomcu-vars-19.1.0-166_19.1.0-166_all.deb ...\n",
            "Unpacking intel-comp-nomcu-vars-19.1.0-166 (19.1.0-166) ...\n",
            "Selecting previously unselected package intel-conda-index-tool-19.1.0-166.\n",
            "Preparing to unpack .../02-intel-conda-index-tool-19.1.0-166_19.1.0-166_amd64.deb ...\n",
            "Unpacking intel-conda-index-tool-19.1.0-166 (19.1.0-166) ...\n",
            "Selecting previously unselected package intel-conda-intel-openmp-linux-64-shadow-package-19.1.0-166.\n",
            "Preparing to unpack .../03-intel-conda-intel-openmp-linux-64-shadow-package-19.1.0-166_19.1.0-166_amd64.deb ...\n",
            "Unpacking intel-conda-intel-openmp-linux-64-shadow-package-19.1.0-166 (19.1.0-166) ...\n",
            "Selecting previously unselected package intel-tbb-libs-2020.0-166.\n",
            "Preparing to unpack .../04-intel-tbb-libs-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-tbb-libs-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-conda-tbb-linux-64-shadow-package-2020.0-166.\n",
            "Preparing to unpack .../05-intel-conda-tbb-linux-64-shadow-package-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-conda-tbb-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-openmp-19.1.0-166.\n",
            "Preparing to unpack .../06-intel-openmp-19.1.0-166_19.1.0-166_amd64.deb ...\n",
            "Unpacking intel-openmp-19.1.0-166 (19.1.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-doc-2020.\n",
            "Preparing to unpack .../07-intel-mkl-doc-2020_2020.4-304_all.deb ...\n",
            "Unpacking intel-mkl-doc-2020 (2020.4-304) ...\n",
            "Selecting previously unselected package intel-mkl-common-2020.0-166.\n",
            "Preparing to unpack .../08-intel-mkl-common-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-common-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-core-rt-2020.0-166.\n",
            "Preparing to unpack .../09-intel-mkl-core-rt-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-core-rt-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-core-2020.0-166.\n",
            "Preparing to unpack .../10-intel-mkl-core-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-core-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-conda-mkl-linux-64-shadow-package-2020.0-166.\n",
            "Preparing to unpack .../11-intel-conda-mkl-linux-64-shadow-package-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-conda-mkl-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-conda-mkl-include-linux-64-shadow-package-2020.0-166.\n",
            "Preparing to unpack .../12-intel-conda-mkl-include-linux-64-shadow-package-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-conda-mkl-include-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-conda-mkl-devel-linux-64-shadow-package-2020.0-166.\n",
            "Preparing to unpack .../13-intel-conda-mkl-devel-linux-64-shadow-package-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-conda-mkl-devel-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-conda-mkl-static-linux-64-shadow-package-2020.0-166.\n",
            "Preparing to unpack .../14-intel-conda-mkl-static-linux-64-shadow-package-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-conda-mkl-static-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-cluster-rt-2020.0-166.\n",
            "Preparing to unpack .../15-intel-mkl-cluster-rt-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-cluster-rt-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-cluster-2020.0-166.\n",
            "Preparing to unpack .../16-intel-mkl-cluster-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-cluster-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-common-c-2020.0-166.\n",
            "Preparing to unpack .../17-intel-mkl-common-c-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-common-c-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-cluster-c-2020.0-166.\n",
            "Preparing to unpack .../18-intel-mkl-cluster-c-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-cluster-c-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-common-f-2020.0-166.\n",
            "Preparing to unpack .../19-intel-mkl-common-f-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-common-f-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-cluster-f-2020.0-166.\n",
            "Preparing to unpack .../20-intel-mkl-cluster-f-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-cluster-f-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-common-ps-2020.0-166.\n",
            "Preparing to unpack .../21-intel-mkl-common-ps-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-common-ps-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-doc-ps-2020.\n",
            "Preparing to unpack .../22-intel-mkl-doc-ps-2020_2020.4-304_all.deb ...\n",
            "Unpacking intel-mkl-doc-ps-2020 (2020.4-304) ...\n",
            "Selecting previously unselected package intel-mkl-common-c-ps-2020.0-166.\n",
            "Preparing to unpack .../23-intel-mkl-common-c-ps-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-common-c-ps-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-core-c-2020.0-166.\n",
            "Preparing to unpack .../24-intel-mkl-core-c-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-core-c-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-core-f-2020.0-166.\n",
            "Preparing to unpack .../25-intel-mkl-core-f-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-core-f-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-core-ps-2020.0-166.\n",
            "Preparing to unpack .../26-intel-mkl-core-ps-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-core-ps-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-f95-common-2020.0-166.\n",
            "Preparing to unpack .../27-intel-mkl-f95-common-2020.0-166_2020.0-166_all.deb ...\n",
            "Unpacking intel-mkl-f95-common-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-f95-2020.0-166.\n",
            "Preparing to unpack .../28-intel-mkl-f95-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-f95-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-gnu-rt-2020.0-166.\n",
            "Preparing to unpack .../29-intel-mkl-gnu-rt-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-gnu-rt-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-gnu-2020.0-166.\n",
            "Preparing to unpack .../30-intel-mkl-gnu-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-gnu-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-gnu-c-2020.0-166.\n",
            "Preparing to unpack .../31-intel-mkl-gnu-c-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-gnu-c-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-gnu-f-rt-2020.0-166.\n",
            "Preparing to unpack .../32-intel-mkl-gnu-f-rt-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-gnu-f-rt-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-gnu-f-2020.0-166.\n",
            "Preparing to unpack .../33-intel-mkl-gnu-f-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-gnu-f-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-pgi-rt-2020.0-166.\n",
            "Preparing to unpack .../34-intel-mkl-pgi-rt-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-pgi-rt-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-pgi-2020.0-166.\n",
            "Preparing to unpack .../35-intel-mkl-pgi-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-pgi-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-pgi-c-2020.0-166.\n",
            "Preparing to unpack .../36-intel-mkl-pgi-c-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-pgi-c-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-psxe-2020.0-088.\n",
            "Preparing to unpack .../37-intel-mkl-psxe-2020.0-088_2020.0-088_all.deb ...\n",
            "Unpacking intel-mkl-psxe-2020.0-088 (2020.0-088) ...\n",
            "Selecting previously unselected package intel-mkl-tbb-rt-2020.0-166.\n",
            "Preparing to unpack .../38-intel-mkl-tbb-rt-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-tbb-rt-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-mkl-tbb-2020.0-166.\n",
            "Preparing to unpack .../39-intel-mkl-tbb-2020.0-166_2020.0-166_amd64.deb ...\n",
            "Unpacking intel-mkl-tbb-2020.0-166 (2020.0-166) ...\n",
            "Selecting previously unselected package intel-psxe-common-doc-2020.\n",
            "Preparing to unpack .../40-intel-psxe-common-doc-2020_2020.1-102_all.deb ...\n",
            "Unpacking intel-psxe-common-doc-2020 (2020.1-102) ...\n",
            "Selecting previously unselected package intel-psxe-common-2020.0-088.\n",
            "Preparing to unpack .../41-intel-psxe-common-2020.0-088_2020.0-088_all.deb ...\n",
            "Unpacking intel-psxe-common-2020.0-088 (2020.0-088) ...\n",
            "Selecting previously unselected package intel-mkl-64bit-2020.0-088.\n",
            "Preparing to unpack .../42-intel-mkl-64bit-2020.0-088_2020.0-088_amd64.deb ...\n",
            "Unpacking intel-mkl-64bit-2020.0-088 (2020.0-088) ...\n",
            "Setting up intel-tbb-libs-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-doc-2020 (2020.4-304) ...\n",
            "Setting up intel-conda-index-tool-19.1.0-166 (19.1.0-166) ...\n",
            "Setting up intel-comp-l-all-vars-19.1.0-166 (19.1.0-166) ...\n",
            "Setting up intel-conda-intel-openmp-linux-64-shadow-package-19.1.0-166 (19.1.0-166) ...\n",
            "Setting up intel-conda-tbb-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-psxe-common-doc-2020 (2020.1-102) ...\n",
            "Setting up intel-mkl-psxe-2020.0-088 (2020.0-088) ...\n",
            "Setting up intel-openmp-19.1.0-166 (19.1.0-166) ...\n",
            "Setting up intel-comp-nomcu-vars-19.1.0-166 (19.1.0-166) ...\n",
            "Setting up intel-mkl-doc-ps-2020 (2020.4-304) ...\n",
            "Setting up intel-psxe-common-2020.0-088 (2020.0-088) ...\n",
            "Setting up intel-mkl-common-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-common-ps-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-common-c-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-common-f-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-core-rt-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-core-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-core-c-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-common-c-ps-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-pgi-rt-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-gnu-rt-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-pgi-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-core-f-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-conda-mkl-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-pgi-c-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-tbb-rt-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-core-ps-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-gnu-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-tbb-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-gnu-f-rt-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-f95-common-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-cluster-rt-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-conda-mkl-include-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-cluster-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-conda-mkl-static-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-f95-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-cluster-f-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-gnu-f-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-gnu-c-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-conda-mkl-devel-linux-64-shadow-package-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-cluster-c-2020.0-166 (2020.0-166) ...\n",
            "Setting up intel-mkl-64bit-2020.0-088 (2020.0-088) ...\n",
            "--2022-02-21 14:43:54--  https://github.com/Kitware/CMake/releases/download/v3.10.2/cmake-3.10.2-Linux-x86_64.tar.gz\n",
            "Resolving github.com (github.com)... 140.82.112.3\n",
            "Connecting to github.com (github.com)|140.82.112.3|:443... connected.\n",
            "HTTP request sent, awaiting response... 302 Found\n",
            "Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/537699/e48dcb80-f4c6-11e8-94cd-26b482aee282?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220221%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220221T144355Z&X-Amz-Expires=300&X-Amz-Signature=7be623b4116b26da3d6700fee8d860888cc95b0c64465f9b733d5349bd1d5e52&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=537699&response-content-disposition=attachment%3B%20filename%3Dcmake-3.10.2-Linux-x86_64.tar.gz&response-content-type=application%2Foctet-stream [following]\n",
            "--2022-02-21 14:43:55--  https://objects.githubusercontent.com/github-production-release-asset-2e65be/537699/e48dcb80-f4c6-11e8-94cd-26b482aee282?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220221%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220221T144355Z&X-Amz-Expires=300&X-Amz-Signature=7be623b4116b26da3d6700fee8d860888cc95b0c64465f9b733d5349bd1d5e52&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=537699&response-content-disposition=attachment%3B%20filename%3Dcmake-3.10.2-Linux-x86_64.tar.gz&response-content-type=application%2Foctet-stream\n",
            "Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.109.133, 185.199.108.133, ...\n",
            "Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 34221307 (33M) [application/octet-stream]\n",
            "Saving to: ‘cmake-3.10.2-Linux-x86_64.tar.gz’\n",
            "\n",
            "cmake-3.10.2-Linux- 100%[===================>]  32.64M  91.1MB/s    in 0.4s    \n",
            "\n",
            "2022-02-21 14:43:55 (91.1 MB/s) - ‘cmake-3.10.2-Linux-x86_64.tar.gz’ saved [34221307/34221307]\n",
            "\n",
            "--2022-02-21 14:43:56--  https://github.com/oneapi-src/oneDNN/releases/download/v2.0/dnnl_lnx_2.0.0_cpu_iomp.tgz\n",
            "Resolving github.com (github.com)... 140.82.113.4\n",
            "Connecting to github.com (github.com)|140.82.113.4|:443... connected.\n",
            "HTTP request sent, awaiting response... 302 Found\n",
            "Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/58414589/311ff480-38a1-11eb-8b0e-a6bdf83f0ccf?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220221%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220221T144357Z&X-Amz-Expires=300&X-Amz-Signature=a13b649b1b8a2499b0e6dd38ab74b6b9abe06c25b4dcfa14f6a7d67d10a28d11&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=58414589&response-content-disposition=attachment%3B%20filename%3Ddnnl_lnx_2.0.0_cpu_iomp.tgz&response-content-type=application%2Foctet-stream [following]\n",
            "--2022-02-21 14:43:57--  https://objects.githubusercontent.com/github-production-release-asset-2e65be/58414589/311ff480-38a1-11eb-8b0e-a6bdf83f0ccf?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220221%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220221T144357Z&X-Amz-Expires=300&X-Amz-Signature=a13b649b1b8a2499b0e6dd38ab74b6b9abe06c25b4dcfa14f6a7d67d10a28d11&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=58414589&response-content-disposition=attachment%3B%20filename%3Ddnnl_lnx_2.0.0_cpu_iomp.tgz&response-content-type=application%2Foctet-stream\n",
            "Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.109.133, ...\n",
            "Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 26448541 (25M) [application/octet-stream]\n",
            "Saving to: ‘dnnl_lnx_2.0.0_cpu_iomp.tgz’\n",
            "\n",
            "dnnl_lnx_2.0.0_cpu_ 100%[===================>]  25.22M  34.2MB/s    in 0.7s    \n",
            "\n",
            "2022-02-21 14:43:58 (34.2 MB/s) - ‘dnnl_lnx_2.0.0_cpu_iomp.tgz’ saved [26448541/26448541]\n",
            "\n",
            "Cloning into 'gloo'...\n",
            "remote: Enumerating objects: 3913, done.\u001b[K\n",
            "remote: Counting objects: 100% (154/154), done.\u001b[K\n",
            "remote: Compressing objects: 100% (110/110), done.\u001b[K\n",
            "remote: Total 3913 (delta 80), reused 83 (delta 41), pack-reused 3759\u001b[K\n",
            "Receiving objects: 100% (3913/3913), 1.24 MiB | 8.65 MiB/s, done.\n",
            "Resolving deltas: 100% (2963/2963), done.\n",
            "-- The CXX compiler identification is GNU 7.5.0\n",
            "-- The C compiler identification is GNU 7.5.0\n",
            "-- Check for working CXX compiler: /usr/bin/c++\n",
            "-- Check for working CXX compiler: /usr/bin/c++ -- works\n",
            "-- Detecting CXX compiler ABI info\n",
            "-- Detecting CXX compiler ABI info - done\n",
            "-- Detecting CXX compile features\n",
            "-- Detecting CXX compile features - done\n",
            "-- Check for working C compiler: /usr/bin/cc\n",
            "-- Check for working C compiler: /usr/bin/cc -- works\n",
            "-- Detecting C compiler ABI info\n",
            "-- Detecting C compiler ABI info - done\n",
            "-- Detecting C compile features\n",
            "-- Detecting C compile features - done\n",
            "-- Build type not set -- defaulting to Release\n",
            "-- Gloo build as STATIC library\n",
            "-- Found MPI_C: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so (found version \"3.1\") \n",
            "-- Found MPI_CXX: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so (found version \"3.1\") \n",
            "-- Found MPI: TRUE (found version \"3.1\")  \n",
            "-- MPI include path: /usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/x86_64-linux-gnu/openmpi/include\n",
            "-- MPI libraries: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so/usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so\n",
            "-- Configuring done\n",
            "-- Generating done\n",
            "-- Build files have been written to: /tmp/gloo/build\n",
            "\u001b[35m\u001b[1mScanning dependencies of target gloo\u001b[0m\n",
            "[  5%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/algorithm.cc.o\u001b[0m\n",
            "[  5%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/allgather.cc.o\u001b[0m\n",
            "[  8%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/allgatherv.cc.o\u001b[0m\n",
            "[ 10%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/allreduce.cc.o\u001b[0m\n",
            "[ 13%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/allreduce_local.cc.o\u001b[0m\n",
            "[ 16%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/alltoall.cc.o\u001b[0m\n",
            "[ 18%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/alltoallv.cc.o\u001b[0m\n",
            "[ 21%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/barrier.cc.o\u001b[0m\n",
            "[ 24%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/broadcast.cc.o\u001b[0m\n",
            "[ 27%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/context.cc.o\u001b[0m\n",
            "[ 29%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/gather.cc.o\u001b[0m\n",
            "[ 32%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/gatherv.cc.o\u001b[0m\n",
            "[ 35%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/reduce.cc.o\u001b[0m\n",
            "[ 37%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/scatter.cc.o\u001b[0m\n",
            "[ 40%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/types.cc.o\u001b[0m\n",
            "[ 43%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/common/logging.cc.o\u001b[0m\n",
            "[ 45%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/common/linux.cc.o\u001b[0m\n",
            "[ 48%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/mpi/context.cc.o\u001b[0m\n",
            "In file included from \u001b[01m\u001b[K/tmp/gloo/gloo/transport/pair.h:13:0\u001b[m\u001b[K,\n",
            "                 from \u001b[01m\u001b[K/tmp/gloo/gloo/context.h:15\u001b[m\u001b[K,\n",
            "                 from \u001b[01m\u001b[K/tmp/gloo/gloo/mpi/context.h:11\u001b[m\u001b[K,\n",
            "                 from \u001b[01m\u001b[K/tmp/gloo/gloo/mpi/context.cc:9\u001b[m\u001b[K:\n",
            "\u001b[01m\u001b[K/tmp/gloo/gloo/mpi/context.cc:\u001b[m\u001b[K In destructor ‘\u001b[01m\u001b[Kgloo::mpi::MPIScope::~MPIScope()\u001b[m\u001b[K’:\n",
            "\u001b[01m\u001b[K/tmp/gloo/gloo/common/logging.h:141:58:\u001b[m\u001b[K \u001b[01;35m\u001b[Kwarning: \u001b[m\u001b[Kthrow will always call terminate() [\u001b[01;35m\u001b[K-Wterminate\u001b[m\u001b[K]\n",
            "           r.get_message_and_free(MakeString(__VA_ARGS__))\u001b[01;35m\u001b[K)\u001b[m\u001b[K; \\\n",
            "                                                          \u001b[01;35m\u001b[K^\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[K/tmp/gloo/gloo/common/logging.h:150:3:\u001b[m\u001b[K \u001b[01;36m\u001b[Knote: \u001b[m\u001b[Kin expansion of macro ‘\u001b[01m\u001b[KGLOO_ENFORCE_THAT_IMPL\u001b[m\u001b[K’\n",
            "   \u001b[01;36m\u001b[KGLOO_ENFORCE_THAT_IMPL\u001b[m\u001b[K(Equals((x), (y)), #x \" == \" #y, __VA_ARGS__)\n",
            "   \u001b[01;36m\u001b[K^~~~~~~~~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[K/tmp/gloo/gloo/mpi/context.cc:43:3:\u001b[m\u001b[K \u001b[01;36m\u001b[Knote: \u001b[m\u001b[Kin expansion of macro ‘\u001b[01m\u001b[KGLOO_ENFORCE_EQ\u001b[m\u001b[K’\n",
            "   \u001b[01;36m\u001b[KGLOO_ENFORCE_EQ\u001b[m\u001b[K(rv, MPI_SUCCESS);\n",
            "   \u001b[01;36m\u001b[K^~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[K/tmp/gloo/gloo/common/logging.h:141:58:\u001b[m\u001b[K \u001b[01;36m\u001b[Knote: \u001b[m\u001b[Kin C++11 destructors default to noexcept\n",
            "           r.get_message_and_free(MakeString(__VA_ARGS__))\u001b[01;36m\u001b[K)\u001b[m\u001b[K; \\\n",
            "                                                          \u001b[01;36m\u001b[K^\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[K/tmp/gloo/gloo/common/logging.h:150:3:\u001b[m\u001b[K \u001b[01;36m\u001b[Knote: \u001b[m\u001b[Kin expansion of macro ‘\u001b[01m\u001b[KGLOO_ENFORCE_THAT_IMPL\u001b[m\u001b[K’\n",
            "   \u001b[01;36m\u001b[KGLOO_ENFORCE_THAT_IMPL\u001b[m\u001b[K(Equals((x), (y)), #x \" == \" #y, __VA_ARGS__)\n",
            "   \u001b[01;36m\u001b[K^~~~~~~~~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[K/tmp/gloo/gloo/mpi/context.cc:43:3:\u001b[m\u001b[K \u001b[01;36m\u001b[Knote: \u001b[m\u001b[Kin expansion of macro ‘\u001b[01m\u001b[KGLOO_ENFORCE_EQ\u001b[m\u001b[K’\n",
            "   \u001b[01;36m\u001b[KGLOO_ENFORCE_EQ\u001b[m\u001b[K(rv, MPI_SUCCESS);\n",
            "   \u001b[01;36m\u001b[K^~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "[ 51%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/rendezvous/context.cc.o\u001b[0m\n",
            "[ 54%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/rendezvous/file_store.cc.o\u001b[0m\n",
            "[ 56%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/rendezvous/hash_store.cc.o\u001b[0m\n",
            "[ 59%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/rendezvous/prefix_store.cc.o\u001b[0m\n",
            "[ 62%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/rendezvous/store.cc.o\u001b[0m\n",
            "[ 64%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/address.cc.o\u001b[0m\n",
            "[ 67%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/buffer.cc.o\u001b[0m\n",
            "[ 70%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/context.cc.o\u001b[0m\n",
            "[ 72%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/device.cc.o\u001b[0m\n",
            "[ 75%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/pair.cc.o\u001b[0m\n",
            "[ 78%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/unbound_buffer.cc.o\u001b[0m\n",
            "[ 81%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/tcp/address.cc.o\u001b[0m\n",
            "[ 83%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/tcp/buffer.cc.o\u001b[0m\n",
            "[ 86%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/tcp/context.cc.o\u001b[0m\n",
            "[ 89%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/tcp/device.cc.o\u001b[0m\n",
            "[ 91%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/tcp/loop.cc.o\u001b[0m\n",
            "[ 94%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/tcp/pair.cc.o\u001b[0m\n",
            "[ 97%] \u001b[32mBuilding CXX object gloo/CMakeFiles/gloo.dir/transport/tcp/unbound_buffer.cc.o\u001b[0m\n",
            "[100%] \u001b[32m\u001b[1mLinking CXX static library libgloo.a\u001b[0m\n",
            "[100%] Built target gloo\n",
            "\u001b[36mInstall the project...\u001b[0m\n",
            "-- Install configuration: \"Release\"\n",
            "-- Installing: /usr/local/share/cmake/Gloo/GlooConfig.cmake\n",
            "-- Installing: /usr/local/share/cmake/Gloo/GlooConfigVersion.cmake\n",
            "-- Installing: /usr/local/share/cmake/Gloo/GlooTargets.cmake\n",
            "-- Installing: /usr/local/share/cmake/Gloo/GlooTargets-release.cmake\n",
            "-- Installing: /usr/local/lib/libgloo.a\n",
            "-- Installing: /usr/local/include/gloo/config.h\n",
            "-- Installing: /usr/local/include/gloo/algorithm.h\n",
            "-- Installing: /usr/local/include/gloo/allgather.h\n",
            "-- Installing: /usr/local/include/gloo/allgather_ring.h\n",
            "-- Installing: /usr/local/include/gloo/allgatherv.h\n",
            "-- Installing: /usr/local/include/gloo/allreduce.h\n",
            "-- Installing: /usr/local/include/gloo/allreduce_bcube.h\n",
            "-- Installing: /usr/local/include/gloo/allreduce_halving_doubling.h\n",
            "-- Installing: /usr/local/include/gloo/allreduce_local.h\n",
            "-- Installing: /usr/local/include/gloo/allreduce_ring.h\n",
            "-- Installing: /usr/local/include/gloo/allreduce_ring_chunked.h\n",
            "-- Installing: /usr/local/include/gloo/alltoall.h\n",
            "-- Installing: /usr/local/include/gloo/alltoallv.h\n",
            "-- Installing: /usr/local/include/gloo/barrier.h\n",
            "-- Installing: /usr/local/include/gloo/barrier_all_to_all.h\n",
            "-- Installing: /usr/local/include/gloo/barrier_all_to_one.h\n",
            "-- Installing: /usr/local/include/gloo/broadcast.h\n",
            "-- Installing: /usr/local/include/gloo/broadcast_one_to_all.h\n",
            "-- Installing: /usr/local/include/gloo/context.h\n",
            "-- Installing: /usr/local/include/gloo/gather.h\n",
            "-- Installing: /usr/local/include/gloo/math.h\n",
            "-- Installing: /usr/local/include/gloo/pairwise_exchange.h\n",
            "-- Installing: /usr/local/include/gloo/reduce.h\n",
            "-- Installing: /usr/local/include/gloo/reduce_scatter.h\n",
            "-- Installing: /usr/local/include/gloo/scatter.h\n",
            "-- Installing: /usr/local/include/gloo/types.h\n",
            "-- Installing: /usr/local/include/gloo/common/aligned_allocator.h\n",
            "-- Installing: /usr/local/include/gloo/common/common.h\n",
            "-- Installing: /usr/local/include/gloo/common/error.h\n",
            "-- Installing: /usr/local/include/gloo/common/logging.h\n",
            "-- Installing: /usr/local/include/gloo/common/string.h\n",
            "-- Installing: /usr/local/include/gloo/common/linux.h\n",
            "-- Installing: /usr/local/include/gloo/common/linux_devices.h\n",
            "-- Installing: /usr/local/include/gloo/mpi/context.h\n",
            "-- Installing: /usr/local/include/gloo/rendezvous/file_store.h\n",
            "-- Installing: /usr/local/include/gloo/rendezvous/hash_store.h\n",
            "-- Installing: /usr/local/include/gloo/rendezvous/prefix_store.h\n",
            "-- Installing: /usr/local/include/gloo/rendezvous/store.h\n",
            "-- Installing: /usr/local/include/gloo/rendezvous/context.h\n",
            "-- Installing: /usr/local/include/gloo/transport/address.h\n",
            "-- Installing: /usr/local/include/gloo/transport/buffer.h\n",
            "-- Installing: /usr/local/include/gloo/transport/context.h\n",
            "-- Installing: /usr/local/include/gloo/transport/device.h\n",
            "-- Installing: /usr/local/include/gloo/transport/pair.h\n",
            "-- Installing: /usr/local/include/gloo/transport/unbound_buffer.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/address.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/attr.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/buffer.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/context.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/device.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/loop.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/pair.h\n",
            "-- Installing: /usr/local/include/gloo/transport/tcp/unbound_buffer.h\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "aL7tr8B4z7Y5"
      },
      "source": [
        "Build from current master. Builds the ASR app. Resulting binaries in `/content/flashlight/build/bin/asr`.\n",
        "\n",
        "If using a GPU Colab runtime, build the CUDA backend; else build the CPU backend."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KZs5ucthy38A",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "53f56283-781b-4771-9927-226026b5cb9e"
      },
      "source": [
        "# export necessary env variables\n",
        "%env MKLROOT=/opt/intel/mkl\n",
        "%env ArrayFire_DIR=/opt/arrayfire/share/ArrayFire/cmake\n",
        "%env DNNL_DIR=/opt/dnnl/dnnl_lnx_2.0.0_cpu_iomp/lib/cmake/dnnl\n",
        "\n",
        "if backend == \"CUDA\":\n",
        "  # Total time: ~13 minutes\n",
        "#   !cd flashlight && git checkout d2e1924cb2a2b32b48cc326bb7e332ca3ea54f67 && mkdir -p build && cd build && \\\n",
        "  !cd flashlight && git checkout 8f7af9ec1188bfd7050c47abfac528d21650890f && mkdir -p build && cd build && \\\n",
        "  cmake .. -DCMAKE_BUILD_TYPE=Release \\\n",
        "           -DFL_BUILD_TESTS=OFF \\\n",
        "           -DFL_BUILD_EXAMPLES=OFF \\\n",
        "           -DFL_BUILD_APP_ASR=ON && \\\n",
        "  make -j$(nproc)\n",
        "elif backend == \"CPU\":\n",
        "  # Total time: ~14 minutes\n",
        "#   !cd flashlight && git checkout d2e1924cb2a2b32b48cc326bb7e332ca3ea54f67 && mkdir -p build && cd build && \\\n",
        "  !cd flashlight && git checkout 8f7af9ec1188bfd7050c47abfac528d21650890f && mkdir -p build && cd build && \\\n",
        "  cmake .. -DFL_BACKEND=CPU \\\n",
        "           -DCMAKE_BUILD_TYPE=Release \\\n",
        "           -DFL_BUILD_TESTS=OFF \\\n",
        "           -DFL_BUILD_EXAMPLES=OFF \\\n",
        "           -DFL_BUILD_APP_ASR=ON && \\\n",
        "  make -j$(nproc)\n",
        "else:\n",
        "  raise ValueError(f\"Unknown backend {backend}\")\n"
      ],
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: MKLROOT=/opt/intel/mkl\n",
            "env: ArrayFire_DIR=/opt/arrayfire/share/ArrayFire/cmake\n",
            "env: DNNL_DIR=/opt/dnnl/dnnl_lnx_2.0.0_cpu_iomp/lib/cmake/dnnl\n",
            "Note: checking out '8f7af9ec1188bfd7050c47abfac528d21650890f'.\n",
            "\n",
            "You are in 'detached HEAD' state. You can look around, make experimental\n",
            "changes and commit them, and you can discard any commits you make in this\n",
            "state without impacting any branches by performing another checkout.\n",
            "\n",
            "If you want to create a new branch to retain commits you create, you may\n",
            "do so (now or later) by using -b with the checkout command again. Example:\n",
            "\n",
            "  git checkout -b <new-branch-name>\n",
            "\n",
            "HEAD is now at 8f7af9ec Fixed typo in README.md (#609)\n",
            "-- The CXX compiler identification is GNU 7.5.0\n",
            "-- The C compiler identification is GNU 7.5.0\n",
            "-- Check for working CXX compiler: /usr/bin/c++\n",
            "-- Check for working CXX compiler: /usr/bin/c++ -- works\n",
            "-- Detecting CXX compiler ABI info\n",
            "-- Detecting CXX compiler ABI info - done\n",
            "-- Detecting CXX compile features\n",
            "-- Detecting CXX compile features - done\n",
            "-- Check for working C compiler: /usr/bin/cc\n",
            "-- Check for working C compiler: /usr/bin/cc -- works\n",
            "-- Detecting C compiler ABI info\n",
            "-- Detecting C compiler ABI info - done\n",
            "-- Detecting C compile features\n",
            "-- Detecting C compile features - done\n",
            "-- Performing Test COMPILER_SUPPORTS_RDYNAMIC\n",
            "-- Performing Test COMPILER_SUPPORTS_RDYNAMIC - Success\n",
            "-- -rdynamic supported.\n",
            "-- Will build flashlight libraries.\n",
            "-- MKL_THREADING = OMP\n",
            "-- Looking for sys/types.h\n",
            "-- Looking for sys/types.h - found\n",
            "-- Looking for stdint.h\n",
            "-- Looking for stdint.h - found\n",
            "-- Looking for stddef.h\n",
            "-- Looking for stddef.h - found\n",
            "-- Check size of void*\n",
            "-- Check size of void* - done\n",
            "-- Checking for [mkl_intel_lp64 - mkl_gnu_thread - mkl_core - gomp - pthread - m - dl]\n",
            "--   Library mkl_intel_lp64: /opt/intel/mkl/lib/intel64/libmkl_intel_lp64.so\n",
            "--   Library mkl_gnu_thread: /opt/intel/mkl/lib/intel64/libmkl_gnu_thread.so\n",
            "--   Library mkl_core: /opt/intel/mkl/lib/intel64/libmkl_core.so\n",
            "--   Library gomp: -fopenmp\n",
            "--   Library pthread: /usr/lib/x86_64-linux-gnu/libpthread.so\n",
            "--   Library m: /usr/lib/x86_64-linux-gnu/libm.so\n",
            "--   Library dl: /usr/lib/x86_64-linux-gnu/libdl.so\n",
            "-- Looking for cblas_sgemm\n",
            "-- Looking for cblas_sgemm - found\n",
            "-- MKL library found\n",
            "-- CBLAS found (include: /opt/intel/mkl/include, library: /opt/intel/mkl/lib/intel64/libmkl_intel_lp64.so;/opt/intel/mkl/lib/intel64/libmkl_gnu_thread.so;/opt/intel/mkl/lib/intel64/libmkl_core.so;-fopenmp;/usr/lib/x86_64-linux-gnu/libpthread.so;/usr/lib/x86_64-linux-gnu/libm.so;/usr/lib/x86_64-linux-gnu/libdl.so)\n",
            "-- Could NOT find FFTW3 (missing: FFTW3_DIR)\n",
            "-- Found PkgConfig: /usr/bin/pkg-config (found version \"0.29.1\") \n",
            "-- FindFFTW using pkgconfig: FOUND=1 LIBRARIES=fftw3 LIBRARY_DIRS= LIBDIR=/usr/lib/x86_64-linux-gnu LINK_LIBRARIES=\n",
            "-- FindFTTW using pkgconfig: INCLUDE_DIRS= INCLUDEDIR=/usr/include\n",
            "-- Found FFTW3: /usr/include  \n",
            "-- FFTW found\n",
            "-- Found OpenMP_C: -fopenmp (found version \"4.5\") \n",
            "-- Found OpenMP_CXX: -fopenmp (found version \"4.5\") \n",
            "-- Found OpenMP: TRUE (found version \"4.5\")  \n",
            "-- Looking for pthread.h\n",
            "-- Looking for pthread.h - found\n",
            "-- Looking for pthread_create\n",
            "-- Looking for pthread_create - not found\n",
            "-- Looking for pthread_create in pthreads\n",
            "-- Looking for pthread_create in pthreads - not found\n",
            "-- Looking for pthread_create in pthread\n",
            "-- Looking for pthread_create in pthread - found\n",
            "-- Found Threads: TRUE  \n",
            "-- Looking for KenLM\n",
            "-- Looking for lzma_auto_decoder in /usr/lib/x86_64-linux-gnu/liblzma.so\n",
            "-- Looking for lzma_auto_decoder in /usr/lib/x86_64-linux-gnu/liblzma.so - found\n",
            "-- Looking for lzma_easy_encoder in /usr/lib/x86_64-linux-gnu/liblzma.so\n",
            "-- Looking for lzma_easy_encoder in /usr/lib/x86_64-linux-gnu/liblzma.so - found\n",
            "-- Looking for lzma_lzma_preset in /usr/lib/x86_64-linux-gnu/liblzma.so\n",
            "-- Looking for lzma_lzma_preset in /usr/lib/x86_64-linux-gnu/liblzma.so - found\n",
            "-- Found LibLZMA: /usr/include (found version \"5.2.2\") \n",
            "-- Found BZip2: /usr/lib/x86_64-linux-gnu/libbz2.so (found version \"1.0.6\") \n",
            "-- Looking for BZ2_bzCompressInit\n",
            "-- Looking for BZ2_bzCompressInit - found\n",
            "-- Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version \"1.2.11\") \n",
            "-- Using kenlm library found in /usr/local/lib/libkenlm.a\n",
            "-- Using kenlm utils library found in /usr/local/lib/libkenlm_util.a\n",
            "-- kenlm model.hh found in /usr/local/include/kenlm/lm\n",
            "-- Found kenlm: /usr/local/include  \n",
            "-- Found kenlm (include: /usr/local/include, library: /usr/local/lib/libkenlm.a;/usr/local/lib/libkenlm_util.a;/usr/lib/x86_64-linux-gnu/liblzma.so;/usr/lib/x86_64-linux-gnu/libbz2.so;/usr/lib/x86_64-linux-gnu/libz.so)\n",
            "-- FL_BACKEND is not CUDA - forcing FL_LIBRARIES_USE_CUDA to OFF\n",
            "-- Will build flashlight core and extensions.\n",
            "-- Could NOT find cereal (missing: cereal_DIR)\n",
            "-- Could NOT find cereal (missing: cereal_INCLUDE_DIRS) \n",
            "-- Found cereal (include: )\n",
            "-- cereal NOT found. Will download from source\n",
            "-- Will build flashlight contrib assets.\n",
            "-- Found MPI_C: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so (found version \"3.1\") \n",
            "-- Found MPI_CXX: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so (found version \"3.1\") \n",
            "-- Found MPI: TRUE (found version \"3.1\")  \n",
            "-- MPI_VERSION found:  3.1\n",
            "-- MPI_CXX found\n",
            "-- MPI_CXX compile flags: -pthread\n",
            "-- MPI_CXX include path: /usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/x86_64-linux-gnu/openmpi/include\n",
            "-- MPI_CXX LINK flags path: -pthread\n",
            "-- MPI_CXX libraries: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so/usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so\n",
            "-- MPI_C found\n",
            "-- MPI_C compile flags: -pthread\n",
            "-- MPI_C include path: /usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/x86_64-linux-gnu/openmpi/include\n",
            "-- MPI_C LINK flags path: -pthread\n",
            "-- MPI_C libraries: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so\n",
            "-- ArrayFire found (include: /opt/arrayfire/include, library: ArrayFire::afcuda)\n",
            "-- Could NOT find stb (missing: stb_INCLUDE_DIRS) \n",
            "-- Could not find stb_image.h. Will download stb from github\n",
            "-- Found GLOG: /usr/include  \n",
            "-- Found glog    (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libglog.so)\n",
            "-- GLOG found\n",
            "-- Found gflags: /usr/include  \n",
            "-- Found gflags  (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libgflags.so)\n",
            "-- gflags found\n",
            "-- Building flashlight ASR app\n",
            "-- Could NOT find SndFile (missing: SndFile_DIR)\n",
            "-- Found Ogg: /usr/lib/x86_64-linux-gnu/libogg.so (found version \"1.3.2\") \n",
            "-- Found Vorbis: /usr/lib/x86_64-linux-gnu/libvorbis.so (found version \"1.3.5\") \n",
            "-- Found VorbisEnc: /usr/lib/x86_64-linux-gnu/libvorbisenc.so (found version \"1.3.5\") \n",
            "-- Found FLAC: /usr/lib/x86_64-linux-gnu/libFLAC.so (found version \"1.3.2\") \n",
            "-- Found SndFile: /usr/include  \n",
            "-- Found libsndfile: (lib: /usr/lib/x86_64-linux-gnu/libsndfile.so include: /usr/include\n",
            "-- libsndfile found.\n",
            "-- Configuring done\n",
            "-- Generating done\n",
            "-- Build files have been written to: /content/flashlight/build\n",
            "\u001b[35m\u001b[1mScanning dependencies of target cereal\u001b[0m\n",
            "\u001b[35m\u001b[1mScanning dependencies of target stb\u001b[0m\n",
            "[  1%] \u001b[34m\u001b[1mCreating directories for 'cereal'\u001b[0m\n",
            "[  1%] \u001b[34m\u001b[1mCreating directories for 'stb'\u001b[0m\n",
            "[  1%] \u001b[34m\u001b[1mPerforming download step (git clone) for 'cereal'\u001b[0m\n",
            "[  2%] \u001b[34m\u001b[1mPerforming download step (git clone) for 'stb'\u001b[0m\n",
            "Cloning into 'cereal'...\n",
            "-- stb download command succeeded.  See also /content/flashlight/build/stb/src/stb-stamp/stb-download-*.log\n",
            "[  3%] \u001b[34m\u001b[1mNo patch step for 'stb'\u001b[0m\n",
            "[  3%] \u001b[34m\u001b[1mPerforming update step for 'stb'\u001b[0m\n",
            "[  3%] \u001b[34m\u001b[1mNo configure step for 'stb'\u001b[0m\n",
            "[  4%] \u001b[34m\u001b[1mNo build step for 'stb'\u001b[0m\n",
            "[  5%] \u001b[34m\u001b[1mNo install step for 'stb'\u001b[0m\n",
            "[  5%] \u001b[34m\u001b[1mCompleted 'stb'\u001b[0m\n",
            "[  5%] Built target stb\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl-libraries\u001b[0m\n",
            "[  6%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/set/Hungarian.cpp.o\u001b[0m\n",
            "[  6%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/sequence/criterion/cpu/CriterionUtils.cpp.o\u001b[0m\n",
            "Note: checking out '02eace19a99ce3cd564ca4e379753d69af08c2c8'.\n",
            "\n",
            "You are in 'detached HEAD' state. You can look around, make experimental\n",
            "changes and commit them, and you can discard any commits you make in this\n",
            "state without impacting any branches by performing another checkout.\n",
            "\n",
            "If you want to create a new branch to retain commits you create, you may\n",
            "do so (now or later) by using -b with the checkout command again. Example:\n",
            "\n",
            "  git checkout -b <new-branch-name>\n",
            "\n",
            "HEAD is now at 02eace19 Badges for travis and appveyor\n",
            "[  6%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/sequence/criterion/cpu/ForceAlignmentCriterion.cpp.o\u001b[0m\n",
            "[  6%] \u001b[34m\u001b[1mNo patch step for 'cereal'\u001b[0m\n",
            "[  7%] \u001b[34m\u001b[1mPerforming update step for 'cereal'\u001b[0m\n",
            "[  8%] \u001b[34m\u001b[1mPerforming configure step for 'cereal'\u001b[0m\n",
            "loading initial cache file /content/flashlight/build/cereal/tmp/cereal-cache-Release.cmake\n",
            "-- The C compiler identification is GNU 7.5.0\n",
            "-- The CXX compiler identification is GNU 7.5.0\n",
            "-- Check for working C compiler: /usr/bin/cc\n",
            "-- Check for working C compiler: /usr/bin/cc -- works\n",
            "-- Detecting C compiler ABI info\n",
            "-- Detecting C compiler ABI info - done\n",
            "-- Detecting C compile features\n",
            "-- Detecting C compile features - done\n",
            "-- Check for working CXX compiler: /usr/bin/c++\n",
            "[  9%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/sequence/criterion/cpu/ConnectionistTemporalClassificationCriterion.cpp.o\u001b[0m\n",
            "-- Check for working CXX compiler: /usr/bin/c++ -- works\n",
            "-- Detecting CXX compiler ABI info\n",
            "-- Detecting CXX compiler ABI info - done\n",
            "-- Detecting CXX compile features\n",
            "[  9%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/sequence/criterion/cpu/FullConnectionCriterion.cpp.o\u001b[0m\n",
            "-- Detecting CXX compile features - done\n",
            "-- Configuring done\n",
            "-- Generating done\n",
            "-- Build files have been written to: /content/flashlight/build/cereal/src/cereal\n",
            "[  9%] \u001b[34m\u001b[1mPerforming build step for 'cereal'\u001b[0m\n",
            "make[3]: warning: jobserver unavailable: using -j1.  Add '+' to parent make rule.\n",
            "[  9%] \u001b[34m\u001b[1mNo install step for 'cereal'\u001b[0m\n",
            "[  9%] \u001b[34m\u001b[1mCompleted 'cereal'\u001b[0m\n",
            "[  9%] Built target cereal\n",
            "[ 10%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/sequence/criterion/cpu/ViterbiPath.cpp.o\u001b[0m\n",
            "[ 10%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/Ceplifter.cpp.o\u001b[0m\n",
            "[ 11%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/Dct.cpp.o\u001b[0m\n",
            "[ 11%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/Derivatives.cpp.o\u001b[0m\n",
            "[ 12%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/Dither.cpp.o\u001b[0m\n",
            "[ 12%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/Mfcc.cpp.o\u001b[0m\n",
            "[ 13%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/Mfsc.cpp.o\u001b[0m\n",
            "[ 13%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/PowerSpectrum.cpp.o\u001b[0m\n",
            "[ 13%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/PreEmphasis.cpp.o\u001b[0m\n",
            "[ 14%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/SpeechUtils.cpp.o\u001b[0m\n",
            "[ 14%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/TriFilterbank.cpp.o\u001b[0m\n",
            "[ 15%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/audio/feature/Windowing.cpp.o\u001b[0m\n",
            "[ 15%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/common/String.cpp.o\u001b[0m\n",
            "[ 16%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/common/System.cpp.o\u001b[0m\n",
            "[ 16%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/lm/ConvLM.cpp.o\u001b[0m\n",
            "[ 17%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/lm/ZeroLM.cpp.o\u001b[0m\n",
            "[ 17%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/lm/KenLM.cpp.o\u001b[0m\n",
            "[ 18%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/LexiconDecoder.cpp.o\u001b[0m\n",
            "[ 18%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/LexiconFreeDecoder.cpp.o\u001b[0m\n",
            "[ 18%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/LexiconSeq2SeqDecoder.cpp.o\u001b[0m\n",
            "[ 19%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/LexiconFreeSeq2SeqDecoder.cpp.o\u001b[0m\n",
            "[ 19%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/Trie.cpp.o\u001b[0m\n",
            "[ 20%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/decoder/Utils.cpp.o\u001b[0m\n",
            "[ 20%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/dictionary/Dictionary.cpp.o\u001b[0m\n",
            "[ 21%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/dictionary/Utils.cpp.o\u001b[0m\n",
            "[ 21%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/tokenizer/PartialFileReader.cpp.o\u001b[0m\n",
            "[ 22%] \u001b[32mBuilding CXX object CMakeFiles/fl-libraries.dir/flashlight/lib/text/tokenizer/Tokenizer.cpp.o\u001b[0m\n",
            "[ 22%] \u001b[32m\u001b[1mLinking CXX static library libfl-libraries.a\u001b[0m\n",
            "[ 22%] Built target fl-libraries\n",
            "\u001b[35m\u001b[1mScanning dependencies of target flashlight\u001b[0m\n",
            "[ 23%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/AdaptiveEmbedding.cpp.o\u001b[0m\n",
            "[ 23%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/AsymmetricConv1D.cpp.o\u001b[0m\n",
            "[ 24%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/Conformer.cpp.o\u001b[0m\n",
            "[ 24%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/PositionEmbedding.cpp.o\u001b[0m\n",
            "[ 24%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/RawWavSpecAugment.cpp.o\u001b[0m\n",
            "[ 25%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/Residual.cpp.o\u001b[0m\n",
            "[ 25%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/SinusoidalPositionEmbedding.cpp.o\u001b[0m\n",
            "[ 26%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/Transformer.cpp.o\u001b[0m\n",
            "[ 26%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/TDSBlock.cpp.o\u001b[0m\n",
            "[ 27%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/contrib/modules/SpecAugment.cpp.o\u001b[0m\n",
            "[ 27%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/Utils.cpp.o\u001b[0m\n",
            "[ 28%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/DevicePtr.cpp.o\u001b[0m\n",
            "[ 28%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/Defines.cpp.o\u001b[0m\n",
            "[ 29%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/DynamicBenchmark.cpp.o\u001b[0m\n",
            "[ 29%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/Init.cpp.o\u001b[0m\n",
            "[ 29%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/Logging.cpp.o\u001b[0m\n",
            "[ 30%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/Histogram.cpp.o\u001b[0m\n",
            "[ 30%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/common/Plugin.cpp.o\u001b[0m\n",
            "[ 31%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/Variable.cpp.o\u001b[0m\n",
            "[ 31%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/Functions.cpp.o\u001b[0m\n",
            "[ 32%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/Utils.cpp.o\u001b[0m\n",
            "[ 32%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/backend/cpu/operators/AdvancedIndex.cpp.o\u001b[0m\n",
            "[ 33%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/backend/cpu/Conv2D.cpp.o\u001b[0m\n",
            "[ 33%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/backend/cpu/Pool2D.cpp.o\u001b[0m\n",
            "[ 34%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/backend/cpu/RNN.cpp.o\u001b[0m\n",
            "[ 34%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/backend/cpu/BatchNorm.cpp.o\u001b[0m\n",
            "[ 34%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/autograd/backend/cpu/DnnlUtils.cpp.o\u001b[0m\n",
            "[ 35%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/BatchDataset.cpp.o\u001b[0m\n",
            "[ 35%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/BlobDataset.cpp.o\u001b[0m\n",
            "[ 36%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/ConcatDataset.cpp.o\u001b[0m\n",
            "[ 36%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/Utils.cpp.o\u001b[0m\n",
            "[ 37%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/FileBlobDataset.cpp.o\u001b[0m\n",
            "[ 37%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/MemoryBlobDataset.cpp.o\u001b[0m\n",
            "[ 38%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/MergeDataset.cpp.o\u001b[0m\n",
            "[ 38%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/PrefetchDataset.cpp.o\u001b[0m\n",
            "[ 38%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/ResampleDataset.cpp.o\u001b[0m\n",
            "[ 39%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/ShuffleDataset.cpp.o\u001b[0m\n",
            "[ 39%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/TensorDataset.cpp.o\u001b[0m\n",
            "[ 40%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/dataset/TransformDataset.cpp.o\u001b[0m\n",
            "[ 40%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/distributed/DistributedApi.cpp.o\u001b[0m\n",
            "[ 41%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/distributed/FileStore.cpp.o\u001b[0m\n",
            "[ 41%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/distributed/reducers/InlineReducer.cpp.o\u001b[0m\n",
            "[ 42%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/distributed/reducers/CoalescingReducer.cpp.o\u001b[0m\n",
            "[ 42%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/distributed/backend/cpu/DistributedBackend.cpp.o\u001b[0m\n",
            "[ 43%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/memory/MemoryManagerAdapter.cpp.o\u001b[0m\n",
            "[ 43%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/memory/MemoryManagerInstaller.cpp.o\u001b[0m\n",
            "[ 43%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/memory/managers/DefaultMemoryManager.cpp.o\u001b[0m\n",
            "[ 44%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/memory/managers/CachingMemoryManager.cpp.o\u001b[0m\n",
            "[ 44%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/meter/AverageValueMeter.cpp.o\u001b[0m\n",
            "[ 45%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/meter/CountMeter.cpp.o\u001b[0m\n",
            "[ 45%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/meter/EditDistanceMeter.cpp.o\u001b[0m\n",
            "[ 46%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/meter/FrameErrorMeter.cpp.o\u001b[0m\n",
            "[ 46%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/meter/MSEMeter.cpp.o\u001b[0m\n",
            "[ 47%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/meter/TimeMeter.cpp.o\u001b[0m\n",
            "[ 47%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/meter/TopKMeter.cpp.o\u001b[0m\n",
            "[ 48%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/DistributedUtils.cpp.o\u001b[0m\n",
            "[ 48%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/Init.cpp.o\u001b[0m\n",
            "[ 48%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/Utils.cpp.o\u001b[0m\n",
            "[ 49%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Activations.cpp.o\u001b[0m\n",
            "[ 49%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/AdaptiveSoftMax.cpp.o\u001b[0m\n",
            "[ 50%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/BatchNorm.cpp.o\u001b[0m\n",
            "[ 50%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Container.cpp.o\u001b[0m\n",
            "[ 51%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Conv2D.cpp.o\u001b[0m\n",
            "[ 51%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Dropout.cpp.o\u001b[0m\n",
            "[ 52%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Embedding.cpp.o\u001b[0m\n",
            "[ 52%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Identity.cpp.o\u001b[0m\n",
            "[ 53%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/LayerNorm.cpp.o\u001b[0m\n",
            "[ 53%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Linear.cpp.o\u001b[0m\n",
            "[ 53%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Loss.cpp.o\u001b[0m\n",
            "[ 54%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Module.cpp.o\u001b[0m\n",
            "[ 54%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Normalize.cpp.o\u001b[0m\n",
            "[ 55%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Padding.cpp.o\u001b[0m\n",
            "[ 55%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/PrecisionCast.cpp.o\u001b[0m\n",
            "[ 56%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Pool2D.cpp.o\u001b[0m\n",
            "[ 56%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Reorder.cpp.o\u001b[0m\n",
            "[ 57%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/RNN.cpp.o\u001b[0m\n",
            "[ 57%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/Transform.cpp.o\u001b[0m\n",
            "[ 57%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/View.cpp.o\u001b[0m\n",
            "[ 58%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/nn/modules/WeightNorm.cpp.o\u001b[0m\n",
            "[ 58%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/Optimizers.cpp.o\u001b[0m\n",
            "[ 59%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/Utils.cpp.o\u001b[0m\n",
            "[ 59%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/AdamOptimizer.cpp.o\u001b[0m\n",
            "[ 60%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/AdadeltaOptimizer.cpp.o\u001b[0m\n",
            "[ 60%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/AdagradOptimizer.cpp.o\u001b[0m\n",
            "[ 61%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/AMSgradOptimizer.cpp.o\u001b[0m\n",
            "[ 61%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/NAGOptimizer.cpp.o\u001b[0m\n",
            "[ 62%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/NovogradOptimizer.cpp.o\u001b[0m\n",
            "[ 62%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/RMSPropOptimizer.cpp.o\u001b[0m\n",
            "[ 62%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/optim/SGDOptimizer.cpp.o\u001b[0m\n",
            "[ 63%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/backend/af/ArrayFireTensor.cpp.o\u001b[0m\n",
            "[ 63%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/backend/af/Compute.cpp.o\u001b[0m\n",
            "[ 64%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/backend/af/Random.cpp.o\u001b[0m\n",
            "[ 64%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/backend/af/Utils.cpp.o\u001b[0m\n",
            "[ 65%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/Shape.cpp.o\u001b[0m\n",
            "[ 65%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/TensorBase.cpp.o\u001b[0m\n",
            "[ 66%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/TensorAdapter.cpp.o\u001b[0m\n",
            "[ 66%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/fl/tensor/Types.cpp.o\u001b[0m\n",
            "[ 67%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/amp/DynamicScaler.cpp.o\u001b[0m\n",
            "[ 67%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/common/SequentialBuilder.cpp.o\u001b[0m\n",
            "[ 67%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/common/DistributedUtils.cpp.o\u001b[0m\n",
            "[ 68%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/af/Transforms.cpp.o\u001b[0m\n",
            "[ 68%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/af/Jpeg.cpp.o\u001b[0m\n",
            "[ 69%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/fl/models/Resnet.cpp.o\u001b[0m\n",
            "[ 69%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/fl/models/ResnetFrozenBatchNorm.cpp.o\u001b[0m\n",
            "[ 70%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/fl/models/ViT.cpp.o\u001b[0m\n",
            "[ 70%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/fl/nn/VisionTransformer.cpp.o\u001b[0m\n",
            "[ 71%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/fl/nn/FrozenBatchNorm.cpp.o\u001b[0m\n",
            "[ 71%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/fl/dataset/DistributedDataset.cpp.o\u001b[0m\n",
            "[ 72%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/image/fl/dataset/Jpeg.cpp.o\u001b[0m\n",
            "[ 72%] \u001b[32mBuilding CXX object CMakeFiles/flashlight.dir/flashlight/ext/plugin/ModulePlugin.cpp.o\u001b[0m\n",
            "[ 72%] \u001b[32m\u001b[1mLinking CXX static library libflashlight.a\u001b[0m\n",
            "[ 72%] Built target flashlight\n",
            "\u001b[35m\u001b[1mScanning dependencies of target flashlight-app-common\u001b[0m\n",
            "[ 72%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-common.dir/flashlight/app/common/Runtime.cpp.o\u001b[0m\n",
            "[ 73%] \u001b[32m\u001b[1mLinking CXX static library libflashlight-app-common.a\u001b[0m\n",
            "[ 73%] Built target flashlight-app-common\n",
            "\u001b[35m\u001b[1mScanning dependencies of target flashlight-app-asr\u001b[0m\n",
            "[ 74%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/common/Flags.cpp.o\u001b[0m\n",
            "[ 74%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/backend/cpu/ConnectionistTemporalClassificationCriterion.cpp.o\u001b[0m\n",
            "[ 75%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/backend/cpu/CriterionUtils.cpp.o\u001b[0m\n",
            "[ 75%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/backend/cpu/ForceAlignmentCriterion.cpp.o\u001b[0m\n",
            "[ 76%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/backend/cpu/FullConnectionCriterion.cpp.o\u001b[0m\n",
            "[ 76%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/ConnectionistTemporalClassificationCriterion.cpp.o\u001b[0m\n",
            "[ 77%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/CriterionUtils.cpp.o\u001b[0m\n",
            "[ 77%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/ForceAlignmentCriterion.cpp.o\u001b[0m\n",
            "[ 77%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/Seq2SeqCriterion.cpp.o\u001b[0m\n",
            "[ 78%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/FullConnectionCriterion.cpp.o\u001b[0m\n",
            "[ 78%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/TransformerCriterion.cpp.o\u001b[0m\n",
            "[ 79%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/ContentAttention.cpp.o\u001b[0m\n",
            "[ 79%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/LocationAttention.cpp.o\u001b[0m\n",
            "[ 80%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/MultiHeadAttention.cpp.o\u001b[0m\n",
            "[ 80%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/Utils.cpp.o\u001b[0m\n",
            "[ 81%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/MedianWindow.cpp.o\u001b[0m\n",
            "[ 81%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/SoftPretrainWindow.cpp.o\u001b[0m\n",
            "[ 82%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/SoftWindow.cpp.o\u001b[0m\n",
            "[ 82%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/StepWindow.cpp.o\u001b[0m\n",
            "[ 82%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/criterion/attention/WindowBase.cpp.o\u001b[0m\n",
            "[ 83%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/data/FeatureTransforms.cpp.o\u001b[0m\n",
            "[ 83%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/data/ListFileDataset.cpp.o\u001b[0m\n",
            "[ 84%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/data/Sound.cpp.o\u001b[0m\n",
            "[ 84%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/data/Utils.cpp.o\u001b[0m\n",
            "[ 85%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/decoder/ConvLmModule.cpp.o\u001b[0m\n",
            "[ 85%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/decoder/DecodeMaster.cpp.o\u001b[0m\n",
            "[ 86%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/decoder/DecodeUtils.cpp.o\u001b[0m\n",
            "[ 86%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/decoder/PlGenerator.cpp.o\u001b[0m\n",
            "[ 87%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/decoder/TranscriptionUtils.cpp.o\u001b[0m\n",
            "[ 87%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/runtime/Attention.cpp.o\u001b[0m\n",
            "[ 87%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/runtime/Logger.cpp.o\u001b[0m\n",
            "[ 88%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/runtime/SpeechStatMeter.cpp.o\u001b[0m\n",
            "[ 88%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/runtime/Optimizer.cpp.o\u001b[0m\n",
            "[ 89%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/runtime/Helpers.cpp.o\u001b[0m\n",
            "[ 89%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/augmentation/AdditiveNoise.cpp.o\u001b[0m\n",
            "[ 90%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/augmentation/GaussianNoise.cpp.o\u001b[0m\n",
            "[ 90%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/augmentation/Reverberation.cpp.o\u001b[0m\n",
            "[ 91%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/augmentation/SoundEffect.cpp.o\u001b[0m\n",
            "[ 91%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/augmentation/SoundEffectConfig.cpp.o\u001b[0m\n",
            "[ 92%] \u001b[32mBuilding CXX object CMakeFiles/flashlight-app-asr.dir/flashlight/app/asr/augmentation/SoundEffectUtil.cpp.o\u001b[0m\n",
            "[ 92%] \u001b[32m\u001b[1mLinking CXX static library libflashlight-app-asr.a\u001b[0m\n",
            "[ 92%] Built target flashlight-app-asr\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_sfx_apply\u001b[0m\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_test\u001b[0m\n",
            "[ 92%] \u001b[32mBuilding CXX object CMakeFiles/fl_asr_sfx_apply.dir/flashlight/app/asr/augmentation/SoundEffectApply.cpp.o\u001b[0m\n",
            "[ 92%] \u001b[32mBuilding CXX object CMakeFiles/fl_asr_test.dir/flashlight/app/asr/Test.cpp.o\u001b[0m\n",
            "[ 93%] \u001b[32m\u001b[1mLinking CXX executable bin/asr/fl_asr_sfx_apply\u001b[0m\n",
            "[ 93%] Built target fl_asr_sfx_apply\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_decode\u001b[0m\n",
            "[ 93%] \u001b[32mBuilding CXX object CMakeFiles/fl_asr_decode.dir/flashlight/app/asr/Decode.cpp.o\u001b[0m\n",
            "[ 94%] \u001b[32m\u001b[1mLinking CXX executable bin/asr/fl_asr_test\u001b[0m\n",
            "[ 95%] \u001b[32m\u001b[1mLinking CXX executable bin/asr/fl_asr_decode\u001b[0m\n",
            "[ 95%] Built target fl_asr_test\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_train\u001b[0m\n",
            "[ 95%] \u001b[32mBuilding CXX object CMakeFiles/fl_asr_train.dir/flashlight/app/asr/Train.cpp.o\u001b[0m\n",
            "[ 95%] Built target fl_asr_decode\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_tutorial_inference_ctc\u001b[0m\n",
            "[ 96%] \u001b[32mBuilding CXX object CMakeFiles/fl_asr_tutorial_inference_ctc.dir/flashlight/app/asr/tutorial/InferenceCTC.cpp.o\u001b[0m\n",
            "[ 96%] \u001b[32m\u001b[1mLinking CXX executable bin/asr/fl_asr_tutorial_inference_ctc\u001b[0m\n",
            "[ 96%] Built target fl_asr_tutorial_inference_ctc\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_tutorial_finetune_ctc\u001b[0m\n",
            "[ 97%] \u001b[32mBuilding CXX object CMakeFiles/fl_asr_tutorial_finetune_ctc.dir/flashlight/app/asr/tutorial/FinetuneCTC.cpp.o\u001b[0m\n",
            "[ 97%] \u001b[32m\u001b[1mLinking CXX executable bin/asr/fl_asr_train\u001b[0m\n",
            "[ 97%] Built target fl_asr_train\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_voice_activity_detection_ctc\u001b[0m\n",
            "[ 98%] \u001b[32mBuilding CXX object flashlight/app/asr/tools/CMakeFiles/fl_asr_voice_activity_detection_ctc.dir/VoiceActivityDetection-CTC.cpp.o\u001b[0m\n",
            "[ 98%] \u001b[32m\u001b[1mLinking CXX executable bin/asr/fl_asr_tutorial_finetune_ctc\u001b[0m\n",
            "[ 98%] Built target fl_asr_tutorial_finetune_ctc\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_align\u001b[0m\n",
            "[ 99%] \u001b[32mBuilding CXX object flashlight/app/asr/tools/CMakeFiles/fl_asr_align.dir/alignment/Align.cpp.o\u001b[0m\n",
            "[ 99%] \u001b[32m\u001b[1mLinking CXX executable ../../../../bin/asr/fl_asr_voice_activity_detection_ctc\u001b[0m\n",
            "[ 99%] Built target fl_asr_voice_activity_detection_ctc\n",
            "\u001b[35m\u001b[1mScanning dependencies of target fl_asr_arch_benchmark\u001b[0m\n",
            "[ 99%] \u001b[32mBuilding CXX object flashlight/app/asr/tools/CMakeFiles/fl_asr_arch_benchmark.dir/benchmark/ArchBenchmark.cpp.o\u001b[0m\n",
            "[100%] \u001b[32m\u001b[1mLinking CXX executable ../../../../bin/asr/fl_asr_arch_benchmark\u001b[0m\n",
            "[100%] Built target fl_asr_arch_benchmark\n",
            "[100%] \u001b[32m\u001b[1mLinking CXX executable ../../../../bin/asr/fl_asr_align\u001b[0m\n",
            "[100%] Built target fl_asr_align\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "e-V0U-Dow-vs"
      },
      "source": [
        "Let's take a look around."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "k6tRnX1iHCoX",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "665373db-7e83-4b04-f688-b762d4a1714c"
      },
      "source": [
        "# Binaries are located in\n",
        "!ls flashlight/build/bin/asr"
      ],
      "execution_count": 4,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "fl_asr_align\t       fl_asr_sfx_apply  fl_asr_tutorial_finetune_ctc\n",
            "fl_asr_arch_benchmark  fl_asr_test\t fl_asr_tutorial_inference_ctc\n",
            "fl_asr_decode\t       fl_asr_train\t fl_asr_voice_activity_detection_ctc\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "T9078zTzcdS3"
      },
      "source": [
        "## Inference Step 0: Preparation\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "DfTJdH646cHb"
      },
      "source": [
        "### Download Models\n",
        "Download acoustic model, tokens, and a few audio files for testing."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "RPDEovLVc46Z",
        "outputId": "58bb769d-dd7e-4ef5-9da8-0b5b8ab355ee"
      },
      "source": [
        "!wget https://dl.fbaipublicfiles.com/wav2letter/mling_pl/tokens-all.lst\n",
        "!wget https://dl.fbaipublicfiles.com/wav2letter/mling_pl/checkpoint_cv_finetune.bin # acoustic model (large)\n",
        "!mkdir audio\n",
        "for i in range(5):\n",
        "  path = \"https://dl.fbaipublicfiles.com/wav2letter/rasr/tutorial/audio/116-288045-000{}.flac\".format(i)\n",
        "  !cd audio && wget $path"
      ],
      "execution_count": 5,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "--2022-02-21 15:14:19--  https://dl.fbaipublicfiles.com/wav2letter/rasr/tutorial/lexicon.txt\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 4965720 (4.7M) [text/plain]\n",
            "Saving to: ‘lexicon.txt.1’\n",
            "\n",
            "lexicon.txt.1       100%[===================>]   4.74M  6.18MB/s    in 0.8s    \n",
            "\n",
            "2022-02-21 15:14:20 (6.18 MB/s) - ‘lexicon.txt.1’ saved [4965720/4965720]\n",
            "\n",
            "--2022-02-21 15:14:20--  https://dl.fbaipublicfiles.com/wav2letter/mling_pl/tokens-all.lst\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 31534 (31K) [binary/octet-stream]\n",
            "Saving to: ‘tokens-all.lst.1’\n",
            "\n",
            "tokens-all.lst.1    100%[===================>]  30.79K  --.-KB/s    in 0.1s    \n",
            "\n",
            "2022-02-21 15:14:21 (304 KB/s) - ‘tokens-all.lst.1’ saved [31534/31534]\n",
            "\n",
            "--2022-02-21 15:14:21--  https://dl.fbaipublicfiles.com/wav2letter/mling_pl/checkpoint_base_cvft.bin\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 8470881011 (7.9G) [application/octet-stream]\n",
            "Saving to: ‘checkpoint_base_cvft.bin.1’\n",
            "\n",
            "checkpoint_base_cvf 100%[===================>]   7.89G  28.4MB/s    in 4m 3s   \n",
            "\n",
            "2022-02-21 15:18:25 (33.2 MB/s) - ‘checkpoint_base_cvft.bin.1’ saved [8470881011/8470881011]\n",
            "\n",
            "mkdir: cannot create directory ‘audio’: File exists\n",
            "--2022-02-21 15:18:25--  https://dl.fbaipublicfiles.com/wav2letter/rasr/tutorial/audio/116-288045-0000.flac\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 200761 (196K) [audio/flac]\n",
            "Saving to: ‘116-288045-0000.flac.1’\n",
            "\n",
            "116-288045-0000.fla 100%[===================>] 196.06K   614KB/s    in 0.3s    \n",
            "\n",
            "2022-02-21 15:18:26 (614 KB/s) - ‘116-288045-0000.flac.1’ saved [200761/200761]\n",
            "\n",
            "--2022-02-21 15:18:26--  https://dl.fbaipublicfiles.com/wav2letter/rasr/tutorial/audio/116-288045-0001.flac\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 149910 (146K) [audio/flac]\n",
            "Saving to: ‘116-288045-0001.flac.1’\n",
            "\n",
            "116-288045-0001.fla 100%[===================>] 146.40K   467KB/s    in 0.3s    \n",
            "\n",
            "2022-02-21 15:18:27 (467 KB/s) - ‘116-288045-0001.flac.1’ saved [149910/149910]\n",
            "\n",
            "--2022-02-21 15:18:27--  https://dl.fbaipublicfiles.com/wav2letter/rasr/tutorial/audio/116-288045-0002.flac\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 173844 (170K) [audio/flac]\n",
            "Saving to: ‘116-288045-0002.flac.1’\n",
            "\n",
            "116-288045-0002.fla 100%[===================>] 169.77K   571KB/s    in 0.3s    \n",
            "\n",
            "2022-02-21 15:18:28 (571 KB/s) - ‘116-288045-0002.flac.1’ saved [173844/173844]\n",
            "\n",
            "--2022-02-21 15:18:28--  https://dl.fbaipublicfiles.com/wav2letter/rasr/tutorial/audio/116-288045-0003.flac\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 70783 (69K) [audio/flac]\n",
            "Saving to: ‘116-288045-0003.flac.1’\n",
            "\n",
            "116-288045-0003.fla 100%[===================>]  69.12K   409KB/s    in 0.2s    \n",
            "\n",
            "2022-02-21 15:18:29 (409 KB/s) - ‘116-288045-0003.flac.1’ saved [70783/70783]\n",
            "\n",
            "--2022-02-21 15:18:29--  https://dl.fbaipublicfiles.com/wav2letter/rasr/tutorial/audio/116-288045-0004.flac\n",
            "Resolving dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)... 104.22.75.142, 104.22.74.142, 172.67.9.4, ...\n",
            "Connecting to dl.fbaipublicfiles.com (dl.fbaipublicfiles.com)|104.22.75.142|:443... connected.\n",
            "HTTP request sent, awaiting response... 200 OK\n",
            "Length: 72270 (71K) [audio/flac]\n",
            "Saving to: ‘116-288045-0004.flac.1’\n",
            "\n",
            "116-288045-0004.fla 100%[===================>]  70.58K   323KB/s    in 0.2s    \n",
            "\n",
            "2022-02-21 15:18:30 (323 KB/s) - ‘116-288045-0004.flac.1’ saved [72270/72270]\n",
            "\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cuqJOR8_-nKJ"
      },
      "source": [
        "### Install dependencies to record/process audio"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "gBmO_t36eTU-",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "869ff41f-2bc5-4ae0-8c69-4200a4ac068c"
      },
      "source": [
        "!apt-get install sox\n",
        "!pip install ffmpeg-python sox"
      ],
      "execution_count": 6,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Reading package lists... Done\n",
            "Building dependency tree       \n",
            "Reading state information... Done\n",
            "The following packages were automatically installed and are no longer required:\n",
            "  cuda-command-line-tools-10-0 cuda-command-line-tools-10-1\n",
            "  cuda-command-line-tools-11-0 cuda-compiler-10-0 cuda-compiler-10-1\n",
            "  cuda-compiler-11-0 cuda-cuobjdump-10-0 cuda-cuobjdump-10-1\n",
            "  cuda-cuobjdump-11-0 cuda-cupti-10-0 cuda-cupti-10-1 cuda-cupti-11-0\n",
            "  cuda-cupti-dev-11-0 cuda-documentation-10-0 cuda-documentation-10-1\n",
            "  cuda-documentation-11-0 cuda-documentation-11-1 cuda-gdb-10-0 cuda-gdb-10-1\n",
            "  cuda-gdb-11-0 cuda-gpu-library-advisor-10-0 cuda-gpu-library-advisor-10-1\n",
            "  cuda-libraries-10-0 cuda-libraries-10-1 cuda-libraries-11-0\n",
            "  cuda-memcheck-10-0 cuda-memcheck-10-1 cuda-memcheck-11-0 cuda-nsight-10-0\n",
            "  cuda-nsight-10-1 cuda-nsight-11-0 cuda-nsight-11-1 cuda-nsight-compute-10-0\n",
            "  cuda-nsight-compute-10-1 cuda-nsight-compute-11-0 cuda-nsight-compute-11-1\n",
            "  cuda-nsight-systems-10-1 cuda-nsight-systems-11-0 cuda-nsight-systems-11-1\n",
            "  cuda-nvcc-10-0 cuda-nvcc-10-1 cuda-nvcc-11-0 cuda-nvdisasm-10-0\n",
            "  cuda-nvdisasm-10-1 cuda-nvdisasm-11-0 cuda-nvml-dev-10-0 cuda-nvml-dev-10-1\n",
            "  cuda-nvml-dev-11-0 cuda-nvprof-10-0 cuda-nvprof-10-1 cuda-nvprof-11-0\n",
            "  cuda-nvprune-10-0 cuda-nvprune-10-1 cuda-nvprune-11-0 cuda-nvtx-10-0\n",
            "  cuda-nvtx-10-1 cuda-nvtx-11-0 cuda-nvvp-10-0 cuda-nvvp-10-1 cuda-nvvp-11-0\n",
            "  cuda-nvvp-11-1 cuda-samples-10-0 cuda-samples-10-1 cuda-samples-11-0\n",
            "  cuda-samples-11-1 cuda-sanitizer-11-0 cuda-sanitizer-api-10-1\n",
            "  cuda-toolkit-10-0 cuda-toolkit-10-1 cuda-toolkit-11-0 cuda-toolkit-11-1\n",
            "  cuda-tools-10-0 cuda-tools-10-1 cuda-tools-11-0 cuda-tools-11-1\n",
            "  cuda-visual-tools-10-0 cuda-visual-tools-10-1 cuda-visual-tools-11-0\n",
            "  cuda-visual-tools-11-1 default-jre dkms freeglut3 freeglut3-dev\n",
            "  keyboard-configuration libargon2-0 libcap2 libcryptsetup12\n",
            "  libdevmapper1.02.1 libfontenc1 libidn11 libip4tc0 libjansson4\n",
            "  libnvidia-cfg1-510 libnvidia-common-460 libnvidia-common-510\n",
            "  libnvidia-extra-510 libnvidia-fbc1-510 libnvidia-gl-510 libpam-systemd\n",
            "  libpolkit-agent-1-0 libpolkit-backend-1-0 libpolkit-gobject-1-0 libxfont2\n",
            "  libxi-dev libxkbfile1 libxmu-dev libxmu-headers libxnvctrl0 libxtst6\n",
            "  nsight-compute-2020.2.1 nsight-compute-2022.1.0 nsight-systems-2020.3.2\n",
            "  nsight-systems-2020.3.4 nsight-systems-2021.5.2 nvidia-dkms-510\n",
            "  nvidia-kernel-common-510 nvidia-kernel-source-510 nvidia-modprobe\n",
            "  nvidia-settings openjdk-11-jre policykit-1 policykit-1-gnome python3-xkit\n",
            "  screen-resolution-extra systemd systemd-sysv udev x11-xkb-utils\n",
            "  xserver-common xserver-xorg-core-hwe-18.04 xserver-xorg-video-nvidia-510\n",
            "Use 'apt autoremove' to remove them.\n",
            "The following additional packages will be installed:\n",
            "  libmagic-mgc libmagic1 libopencore-amrnb0 libopencore-amrwb0 libsox-fmt-alsa\n",
            "  libsox-fmt-base libsox3\n",
            "Suggested packages:\n",
            "  file libsox-fmt-all\n",
            "The following NEW packages will be installed:\n",
            "  libmagic-mgc libmagic1 libopencore-amrnb0 libopencore-amrwb0 libsox-fmt-alsa\n",
            "  libsox-fmt-base libsox3 sox\n",
            "0 upgraded, 8 newly installed, 0 to remove and 71 not upgraded.\n",
            "Need to get 760 kB of archives.\n",
            "After this operation, 6,717 kB of additional disk space will be used.\n",
            "Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libopencore-amrnb0 amd64 0.1.3-2.1 [92.0 kB]\n",
            "Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libopencore-amrwb0 amd64 0.1.3-2.1 [45.8 kB]\n",
            "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmagic-mgc amd64 1:5.32-2ubuntu0.4 [184 kB]\n",
            "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmagic1 amd64 1:5.32-2ubuntu0.4 [68.6 kB]\n",
            "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 libsox3 amd64 14.4.2-3ubuntu0.18.04.1 [226 kB]\n",
            "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 libsox-fmt-alsa amd64 14.4.2-3ubuntu0.18.04.1 [10.6 kB]\n",
            "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 libsox-fmt-base amd64 14.4.2-3ubuntu0.18.04.1 [32.1 kB]\n",
            "Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 sox amd64 14.4.2-3ubuntu0.18.04.1 [101 kB]\n",
            "Fetched 760 kB in 1s (607 kB/s)\n",
            "Selecting previously unselected package libopencore-amrnb0:amd64.\n",
            "(Reading database ... 157590 files and directories currently installed.)\n",
            "Preparing to unpack .../0-libopencore-amrnb0_0.1.3-2.1_amd64.deb ...\n",
            "Unpacking libopencore-amrnb0:amd64 (0.1.3-2.1) ...\n",
            "Selecting previously unselected package libopencore-amrwb0:amd64.\n",
            "Preparing to unpack .../1-libopencore-amrwb0_0.1.3-2.1_amd64.deb ...\n",
            "Unpacking libopencore-amrwb0:amd64 (0.1.3-2.1) ...\n",
            "Selecting previously unselected package libmagic-mgc.\n",
            "Preparing to unpack .../2-libmagic-mgc_1%3a5.32-2ubuntu0.4_amd64.deb ...\n",
            "Unpacking libmagic-mgc (1:5.32-2ubuntu0.4) ...\n",
            "Selecting previously unselected package libmagic1:amd64.\n",
            "Preparing to unpack .../3-libmagic1_1%3a5.32-2ubuntu0.4_amd64.deb ...\n",
            "Unpacking libmagic1:amd64 (1:5.32-2ubuntu0.4) ...\n",
            "Selecting previously unselected package libsox3:amd64.\n",
            "Preparing to unpack .../4-libsox3_14.4.2-3ubuntu0.18.04.1_amd64.deb ...\n",
            "Unpacking libsox3:amd64 (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Selecting previously unselected package libsox-fmt-alsa:amd64.\n",
            "Preparing to unpack .../5-libsox-fmt-alsa_14.4.2-3ubuntu0.18.04.1_amd64.deb ...\n",
            "Unpacking libsox-fmt-alsa:amd64 (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Selecting previously unselected package libsox-fmt-base:amd64.\n",
            "Preparing to unpack .../6-libsox-fmt-base_14.4.2-3ubuntu0.18.04.1_amd64.deb ...\n",
            "Unpacking libsox-fmt-base:amd64 (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Selecting previously unselected package sox.\n",
            "Preparing to unpack .../7-sox_14.4.2-3ubuntu0.18.04.1_amd64.deb ...\n",
            "Unpacking sox (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Setting up libmagic-mgc (1:5.32-2ubuntu0.4) ...\n",
            "Setting up libmagic1:amd64 (1:5.32-2ubuntu0.4) ...\n",
            "Setting up libopencore-amrnb0:amd64 (0.1.3-2.1) ...\n",
            "Setting up libopencore-amrwb0:amd64 (0.1.3-2.1) ...\n",
            "Setting up libsox3:amd64 (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Setting up libsox-fmt-base:amd64 (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Setting up libsox-fmt-alsa:amd64 (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Setting up sox (14.4.2-3ubuntu0.18.04.1) ...\n",
            "Processing triggers for libc-bin (2.27-3ubuntu1.3) ...\n",
            "/sbin/ldconfig.real: /usr/local/lib/python3.7/dist-packages/ideep4py/lib/libmkldnn.so.0 is not a symbolic link\n",
            "\n",
            "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...\n",
            "Processing triggers for mime-support (3.60ubuntu1) ...\n",
            "Collecting ffmpeg-python\n",
            "  Downloading ffmpeg_python-0.2.0-py3-none-any.whl (25 kB)\n",
            "Collecting sox\n",
            "  Downloading sox-1.4.1-py2.py3-none-any.whl (39 kB)\n",
            "Requirement already satisfied: future in /usr/local/lib/python3.7/dist-packages (from ffmpeg-python) (0.16.0)\n",
            "Requirement already satisfied: numpy>=1.9.0 in /usr/local/lib/python3.7/dist-packages (from sox) (1.21.5)\n",
            "Installing collected packages: sox, ffmpeg-python\n",
            "Successfully installed ffmpeg-python-0.2.0 sox-1.4.1\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Ryc17nPTds7Q"
      },
      "source": [
        "## Inference Step 1: Record Audio from Your Microphone and Run Inference\n",
        "\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5goRjHy1vRUj"
      },
      "source": [
        "### Let's record!"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "1RscueA4dlz0"
      },
      "source": [
        "from flashlight.scripts.colab.record import record_audio\n",
        "record_audio(\"recorded_audio\") # result --> \"recorded_audio.wav\""
      ],
      "execution_count": 7,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "utVPSMto1Yqh"
      },
      "source": [
        "## Inference Step 2: Run on a Set of Audio Files Provided in the txt File\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "BxKGQ0VHv8A4"
      },
      "source": [
        "### Prepare the file with all audio paths at first"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "oI5oBu88zpM2"
      },
      "source": [
        "# !ls audio/*.flac > audio.lst\n",
        "import glob\n",
        "from subprocess import check_output\n",
        "with open(\"audio.lst\", \"w\") as f:\n",
        "    for i,audio in enumerate(glob.glob(\"audio/*.flac\") + [\"recorded_audio.wav\"]):\n",
        "        duration = float(check_output(\"soxi -D \" + audio, shell=True))\n",
        "        f.write(\"%d %s %s\\n\" % (i, audio, duration))"
      ],
      "execution_count": 8,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "7qyrGTYmKRaB",
        "outputId": "ff3e8265-e2c7-429c-d491-551dc8113a23"
      },
      "source": [
        "!cat audio.lst"
      ],
      "execution_count": 19,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "0 audio/116-288045-0000.flac 10.65\n",
            "1 audio/116-288045-0004.flac 3.72\n",
            "2 audio/116-288045-0001.flac 8.635\n",
            "3 audio/116-288045-0003.flac 3.66\n",
            "4 audio/116-288045-0002.flac 9.625\n",
            "5 recorded_audio.wav 6.48\n",
            "a a |\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "COMPILE MULTILINGUAL MODEL .so"
      ],
      "metadata": {
        "id": "xI7b6biNcHol"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "%cd /content/flashlight/build\n",
        "# !wget https://raw.githubusercontent.com/flashlight/wav2letter/49087d575ddf77aa5a99a01fee980fc00e92c802/recipes/mling_pl/model_with_externally_controlled_reshaping_big_lid.cpp\n",
        "# !mv model_with_externally_controlled_reshaping_big_lid.cpp mling.cpp\n",
        "!cmake .. -DFL_PLUGIN_MODULE_SRC_PATH=mling.cpp\n",
        "# !cmake .. -DFL_PLUGIN_MODULE_SRC_PATH=mling_large.cpp\n",
        "!make"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "NjsAsHy4cKqu",
        "outputId": "8df0ad3c-0fdb-489e-fe6c-e09da178c43a"
      },
      "execution_count": 21,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "/content/flashlight/build\n",
            "-- -rdynamic supported.\n",
            "-- Will build flashlight libraries.\n",
            "-- MKL_THREADING = OMP\n",
            "-- Checking for [mkl_intel_lp64 - mkl_gnu_thread - mkl_core - gomp - pthread - m - dl]\n",
            "--   Library mkl_intel_lp64: /opt/intel/mkl/lib/intel64/libmkl_intel_lp64.so\n",
            "--   Library mkl_gnu_thread: /opt/intel/mkl/lib/intel64/libmkl_gnu_thread.so\n",
            "--   Library mkl_core: /opt/intel/mkl/lib/intel64/libmkl_core.so\n",
            "--   Library gomp: -fopenmp\n",
            "--   Library pthread: /usr/lib/x86_64-linux-gnu/libpthread.so\n",
            "--   Library m: /usr/lib/x86_64-linux-gnu/libm.so\n",
            "--   Library dl: /usr/lib/x86_64-linux-gnu/libdl.so\n",
            "-- MKL library found\n",
            "-- CBLAS found (include: /opt/intel/mkl/include, library: /opt/intel/mkl/lib/intel64/libmkl_intel_lp64.so;/opt/intel/mkl/lib/intel64/libmkl_gnu_thread.so;/opt/intel/mkl/lib/intel64/libmkl_core.so;-fopenmp;/usr/lib/x86_64-linux-gnu/libpthread.so;/usr/lib/x86_64-linux-gnu/libm.so;/usr/lib/x86_64-linux-gnu/libdl.so)\n",
            "-- Could NOT find FFTW3 (missing: FFTW3_DIR)\n",
            "-- FindFFTW using pkgconfig: FOUND=1 LIBRARIES=fftw3 LIBRARY_DIRS= LIBDIR=/usr/lib/x86_64-linux-gnu LINK_LIBRARIES=\n",
            "-- FindFTTW using pkgconfig: INCLUDE_DIRS= INCLUDEDIR=/usr/include\n",
            "-- FFTW found\n",
            "-- Looking for KenLM\n",
            "-- Using kenlm library found in /usr/local/lib/libkenlm.a\n",
            "-- Using kenlm utils library found in /usr/local/lib/libkenlm_util.a\n",
            "-- kenlm model.hh found in /usr/local/include/kenlm/lm\n",
            "-- Found kenlm (include: /usr/local/include, library: /usr/local/lib/libkenlm.a;/usr/local/lib/libkenlm_util.a;/usr/lib/x86_64-linux-gnu/liblzma.so;/usr/lib/x86_64-linux-gnu/libbz2.so;/usr/lib/x86_64-linux-gnu/libz.so)\n",
            "-- FL_BACKEND is not CUDA - forcing FL_LIBRARIES_USE_CUDA to OFF\n",
            "-- Will build flashlight core and extensions.\n",
            "-- Could NOT find cereal (missing: cereal_DIR)\n",
            "-- Could NOT find cereal (missing: cereal_INCLUDE_DIRS) \n",
            "-- Found cereal (include: )\n",
            "-- cereal NOT found. Will download from source\n",
            "-- Will build flashlight contrib assets.\n",
            "-- MPI_VERSION found:  3.1\n",
            "-- MPI_CXX found\n",
            "-- MPI_CXX compile flags: -pthread\n",
            "-- MPI_CXX include path: /usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/x86_64-linux-gnu/openmpi/include\n",
            "-- MPI_CXX LINK flags path: -pthread\n",
            "-- MPI_CXX libraries: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so/usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so\n",
            "-- MPI_C found\n",
            "-- MPI_C compile flags: -pthread\n",
            "-- MPI_C include path: /usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/x86_64-linux-gnu/openmpi/include\n",
            "-- MPI_C LINK flags path: -pthread\n",
            "-- MPI_C libraries: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so\n",
            "-- ArrayFire found (include: /opt/arrayfire/include, library: ArrayFire::afcuda)\n",
            "-- Could NOT find stb (missing: stb_INCLUDE_DIRS) \n",
            "-- Could not find stb_image.h. Will download stb from github\n",
            "-- Building plugin with src mling.cpp\n",
            "-- Found glog    (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libglog.so)\n",
            "-- GLOG found\n",
            "-- Found gflags  (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libgflags.so)\n",
            "-- gflags found\n",
            "-- Building flashlight ASR app\n",
            "-- Could NOT find SndFile (missing: SndFile_DIR)\n",
            "-- Found libsndfile: (lib: /usr/lib/x86_64-linux-gnu/libsndfile.so include: /usr/include\n",
            "-- libsndfile found.\n",
            "-- Configuring done\n",
            "-- Generating done\n",
            "-- Build files have been written to: /content/flashlight/build\n",
            "[  1%] \u001b[34m\u001b[1mPerforming update step for 'cereal'\u001b[0m\n",
            "[  2%] \u001b[34m\u001b[1mPerforming configure step for 'cereal'\u001b[0m\n",
            "loading initial cache file /content/flashlight/build/cereal/tmp/cereal-cache-Release.cmake\n",
            "-- Configuring done\n",
            "-- Generating done\n",
            "-- Build files have been written to: /content/flashlight/build/cereal/src/cereal\n",
            "[  2%] \u001b[34m\u001b[1mPerforming build step for 'cereal'\u001b[0m\n",
            "[  2%] \u001b[34m\u001b[1mNo install step for 'cereal'\u001b[0m\n",
            "[  2%] \u001b[34m\u001b[1mCompleted 'cereal'\u001b[0m\n",
            "[  3%] Built target cereal\n",
            "[  3%] \u001b[34m\u001b[1mPerforming update step for 'stb'\u001b[0m\n",
            "[  3%] \u001b[34m\u001b[1mNo configure step for 'stb'\u001b[0m\n",
            "[  4%] \u001b[34m\u001b[1mNo build step for 'stb'\u001b[0m\n",
            "[  5%] \u001b[34m\u001b[1mNo install step for 'stb'\u001b[0m\n",
            "[  5%] \u001b[34m\u001b[1mCompleted 'stb'\u001b[0m\n",
            "[  7%] Built target stb\n",
            "[ 22%] Built target fl-libraries\n",
            "[ 72%] Built target flashlight\n",
            "[ 73%] Built target flashlight-app-common\n",
            "[ 91%] Built target flashlight-app-asr\n",
            "\u001b[35m\u001b[1mScanning dependencies of target mling\u001b[0m\n",
            "[ 91%] \u001b[32mBuilding CXX object CMakeFiles/mling.dir/mling.cpp.o\u001b[0m\n",
            "[ 92%] \u001b[32m\u001b[1mLinking CXX shared module mling.so\u001b[0m\n",
            "[ 92%] Built target mling\n",
            "[ 92%] Built target fl_asr_sfx_apply\n",
            "[ 93%] Built target fl_asr_test\n",
            "[ 94%] Built target fl_asr_decode\n",
            "[ 95%] Built target fl_asr_train\n",
            "[ 96%] Built target fl_asr_tutorial_inference_ctc\n",
            "[ 97%] Built target fl_asr_tutorial_finetune_ctc\n",
            "[ 98%] Built target fl_asr_voice_activity_detection_ctc\n",
            "[ 99%] Built target fl_asr_align\n",
            "[100%] Built target fl_asr_arch_benchmark\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "MULTILINGUAL MODEL INFERENCE"
      ],
      "metadata": {
        "id": "vSLRLt4mb22d"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# we need a dummy lexicon:\n",
        "!echo 'a a |' > lexicon.txt"
      ],
      "metadata": {
        "id": "8lvhACK8B6r2"
      },
      "execution_count": 17,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "%cd /content\n",
        "# checkpoint_base_cvft.bin\n",
        "# checkpoint_large.bin\n",
        "!./flashlight/build/bin/asr/fl_asr_test \\\n",
        "    --test=audio.lst \\\n",
        "    --am=checkpoint_base_cvft.bin \\\n",
        "    --arch=flashlight/build/mling.so \\\n",
        "    --tokens=tokens-all.lst \\\n",
        "    --lexicon=lexicon.txt \\\n",
        "    --datadir=''  \\\n",
        "    --emission_dir=''  \\\n",
        "    --show \\\n",
        "    --logtostderr=1 \\\n",
        "    --minloglevel=0"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "adNTDjyvb1ha",
        "outputId": "47680beb-9963-41f8-e1c1-d3e82fb64eff"
      },
      "execution_count": 22,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "/content\n",
            "I0221 16:16:05.997638 10328 Test.cpp:76] [Network] Reading acoustic model from checkpoint_base_cvft.bin\n",
            "I0221 16:16:15.735110 10328 Test.cpp:90] [Network] Model myModel: Sequential [input -> (0) -> (1) -> (2) -> (3) -> (4) -> (5) -> output]\n",
            "\t(0): View (-1 1 80 0)\n",
            "\t(1): LayerNorm ( axis : { 0 1 2 } , size : -1)\n",
            "\t(2): Conv2D (80->3072, 7x1, 3,1, SAME,0, 1, 1) (with bias)\n",
            "\t(3): GatedLinearUnit (2)\n",
            "\t(4): Dropout (0.300000)\n",
            "\t(5): Reorder (2,0,3,1)\n",
            "(reshaping happens here)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "Transformer (nHeads: 4), (pDropout: 0.3), (pLayerdrop: 0.3), (bptt: 920), (useMask: 0), (preLayerNorm: 0)\n",
            "(inverse reshaping happens here)\n",
            "CTC head: Linear (1536->8065) (with bias)\n",
            "Language ID head: Linear (1536->60) (with bias)\n",
            "I0221 16:16:15.735337 10328 Test.cpp:91] [Criterion] ConnectionistTemporalClassificationCriterion\n",
            "I0221 16:16:15.735357 10328 Test.cpp:92] [Network] Number of params: 1058849871\n",
            "I0221 16:16:15.735486 10328 Test.cpp:98] [Network] Updating flags from config file: checkpoint_base_cvft.bin\n",
            "I0221 16:16:15.735888 10328 Test.cpp:111] Gflags after parsing \n",
            "--flagfile=; --fromenv=; --tryfromenv=; --undefok=; --tab_completion_columns=80; --tab_completion_word=; --help=false; --helpfull=false; --helpmatch=; --helpon=; --helppackage=false; --helpshort=false; --helpxml=false; --version=false; --adambeta1=0.94999999999999996; --adambeta2=0.98999999999999999; --am=checkpoint_base_cvft.bin; --am_decoder_tr_dropout=0; --am_decoder_tr_layerdrop=0; --am_decoder_tr_layers=1; --arch=flashlight/build/mling.so; --attention=content; --attentionthreshold=2147483647; --attnWindow=no; --attnconvchannel=0; --attnconvkernel=0; --attndim=0; --batching_max_duration=35000; --batching_strategy=dynamic; --batchsize=1; --beamsize=50; --beamsizetoken=5; --beamthreshold=1000000; --channels=1; --criterion=ctc; --critoptim=sgd; --datadir=; --decoderattnround=1; --decoderdropout=0; --decoderrnnlayer=1; --decodertype=wrd; --devwin=0; --emission_dir=; --emission_queue_size=3000; --enable_distributed=true; --encoderdim=0; --eosscore=0; --everstoredb=false; --features_type=mfsc; --fftcachesize=1; --filterbanks=80; --fl_amp_max_scale_factor=32000; --fl_amp_scale_factor=4096; --fl_amp_scale_factor_update_interval=2000; --fl_amp_use_mixed_precision=false; --fl_benchmark_mode=true; --fl_log_level=; --fl_log_mem_ops_interval=0; --fl_optim_mode=; --fl_vlog_level=0; --flagsfile=/checkpoint/wav2letter/locronan/mls_scratch/CV_slimIPL/basic_plus_vox_populi_shuffled_LID_big_traintrain-all-shuffled.lst,all_pseudo_labeled.lst_p_r_sup0_end_step1000100_slimIPL_start100000000_saug_tmaskn2_LID_loss_strength1_saug_start_update50000_lr0.01/basic_plus_vox_populi_shuffled_LID_big.cfg; --framesizems=25; --framestridems=10; --gamma=1; --gumbeltemperature=1; --highfreqfilterbank=-1; --inputfeeding=false; --isbeamdump=false; --iter=9223372036854775807; --itersave=false; --labelsmooth=0; --leftWindowSize=50; --lexicon=lexicon.txt; --linlr=-1; --linlrcrit=-1; --linseg=0; --lm=; --lm_memory=5000; --lm_vocab=; --lmtype=kenlm; --lmweight=0; --lmweight_high=4; --lmweight_low=0; --lmweight_step=0.20000000000000001; --localnrmlleftctx=0; --localnrmlrightctx=0; --logadd=true; --lowfreqfilterbank=0; --lr=0.01; --lr_decay=100000; --lr_decay_step=500; --lrcosine=false; --lrcrit=0; --max_devices_per_node=8; --maxdecoderoutputlen=200; --maxgradnorm=0.10000000000000001; --maxload=-1; --maxrate=10; --maxsil=50; --maxword=-1; --melfloor=1; --mfcccoeffs=13; --minrate=3; --minsil=0; --momentum=0.94999999999999996; --netoptim=adagrad; --nthread=6; --nthread_decoder=1; --nthread_decoder_am_forward=1; --numattnhead=8; --onorm=target; --optimepsilon=1e-08; --optimrho=0.90000000000000002; --pctteacherforcing=100; --pcttraineval=1; --pretrainWindow=0; --replabel=0; --reportiters=10000; --rightWindowSize=50; --rndv_filepath=/checkpoint/wav2letter/locronan/mls_scratch/CV_slimIPL/basic_plus_vox_populi_shuffled_LID_big_traintrain-all-shuffled.lst,all_pseudo_labeled.lst_p_r_sup0_end_step1000100_slimIPL_start100000000_saug_tmaskn2_LID_loss_strength1_saug_start_update50000_lr0.01_CVfinetune; --rundir=/checkpoint/locronan/pls/mls_scratch/CV_slimIPL/basic_plus_vox_populi_shuffled_LID_big_traintrain-all-shuffled.lst,all_pseudo_labeled.lst_p_r_sup0_end_step1000100_slimIPL_start100000000_saug_tmaskn2_LID_loss_strength1_saug_start_update50000_lr0.01; --samplerate=16000; --sampletarget=0; --samplingstrategy=rand; --saug_fmaskf=30; --saug_fmaskn=2; --saug_start_update=50000; --saug_tmaskn=2; --saug_tmaskp=0.10000000000000001; --saug_tmaskt=50; --sclite=; --seed=0; --sfx_config=; --sfx_start_update=2147483647; --show=true; --showletters=false; --silscore=0; --smearing=max; --smoothingtemperature=1; --softwoffset=10; --softwrate=5; --softwstd=5; --sqnorm=true; --stepsize=9223372036854775807; --surround=|; --test=audio.lst; --tokens=tokens-all.lst; --train=train-all-shuffled.lst.filter; --trainWithWindow=false; --transdiag=0; --unkscore=0; --use_memcache=false; --uselexicon=true; --usewordpiece=false; --valid=pl-dev:pl-dev.lst,zh-HK-dev:zh-HK-dev.lst,lv-dev:lv-dev.lst,ka-dev:ka-dev.lst,ar-dev:ar-dev.lst,vi-dev:vi-dev.lst,cs-dev:cs-dev.lst,th-dev:th-dev.lst,pa-IN-dev:pa-IN-dev.lst,it-dev:it-dev.lst,hsb-dev:hsb-dev.lst,sah-dev:sah-dev.lst,ia-dev:ia-dev.lst,tt-dev:tt-dev.lst,as-dev:as-dev.lst,ta-dev:ta-dev.lst,de-dev:de-dev.lst,ab-dev:ab-dev.lst,br-dev:br-dev.lst,ca-dev:ca-dev.lst,cnh-dev:cnh-dev.lst,cv-dev:cv-dev.lst,cy-dev:cy-dev.lst,dv-dev:dv-dev.lst,el-dev:el-dev.lst,en-dev:en-dev.lst,eo-dev:eo-dev.lst,es-dev:es-dev.lst,et-dev:et-dev.lst,eu-dev:eu-dev.lst,fa-dev:fa-dev.lst,fi-dev:fi-dev.lst,fr-dev:fr-dev.lst,fy-NL-dev:fy-NL-dev.lst,ga-IE-dev:ga-IE-dev.lst,hi-dev:hi-dev.lst,hu-dev:hu-dev.lst,id-dev:id-dev.lst,ja-dev:ja-dev.lst,kab-dev:kab-dev.lst,ky-dev:ky-dev.lst,lg-dev:lg-dev.lst,lt-dev:lt-dev.lst,mn-dev:mn-dev.lst,mt-dev:mt-dev.lst,nl-dev:nl-dev.lst,or-dev:or-dev.lst,pt-dev:pt-dev.lst,rm-sursilv-dev:rm-sursilv-dev.lst,rm-vallader-dev:rm-vallader-dev.lst,ro-dev:ro-dev.lst,ru-dev:ru-dev.lst,rw-dev:rw-dev.lst,sl-dev:sl-dev.lst,sv-SE-dev:sv-SE-dev.lst,tr-dev:tr-dev.lst,uk-dev:uk-dev.lst,vot-dev:vot-dev.lst,zh-CN-dev:zh-CN-dev.lst,zh-TW-dev:zh-TW-dev.lst,pl-test:pl-test.lst,zh-HK-test:zh-HK-test.lst,lv-test:lv-test.lst,ka-test:ka-test.lst,ar-test:ar-test.lst,vi-test:vi-test.lst,cs-test:cs-test.lst,th-test:th-test.lst,pa-IN-test:pa-IN-test.lst,it-test:it-test.lst,hsb-test:hsb-test.lst,sah-test:sah-test.lst,ia-test:ia-test.lst,tt-test:tt-test.lst,as-test:as-test.lst,ta-test:ta-test.lst,de-test:de-test.lst,ab-test:ab-test.lst,br-test:br-test.lst,ca-test:ca-test.lst,cnh-test:cnh-test.lst,cv-test:cv-test.lst,cy-test:cy-test.lst,dv-test:dv-test.lst,el-test:el-test.lst,en-test:en-test.lst,eo-test:eo-test.lst,es-test:es-test.lst,et-test:et-test.lst,eu-test:eu-test.lst,fa-test:fa-test.lst,fi-test:fi-test.lst,fr-test:fr-test.lst,fy-NL-test:fy-NL-test.lst,ga-IE-test:ga-IE-test.lst,hi-test:hi-test.lst,hu-test:hu-test.lst,id-test:id-test.lst,ja-test:ja-test.lst,kab-test:kab-test.lst,ky-test:ky-test.lst,lg-test:lg-test.lst,lt-test:lt-test.lst,mn-test:mn-test.lst,mt-test:mt-test.lst,nl-test:nl-test.lst,or-test:or-test.lst,pt-test:pt-test.lst,rm-sursilv-test:rm-sursilv-test.lst,rm-vallader-test:rm-vallader-test.lst,ro-test:ro-test.lst,ru-test:ru-test.lst,rw-test:rw-test.lst,sl-test:sl-test.lst,sv-SE-test:sv-SE-test.lst,tr-test:tr-test.lst,uk-test:uk-test.lst,vot-test:vot-test.lst,zh-CN-test:zh-CN-test.lst,zh-TW-test:zh-TW-test.lst; --validbatchsize=-1; --warmup=64000; --weightdecay=0; --wordscore=0; --wordseparator=|; --world_rank=0; --world_size=64; --alsologtoemail=; --alsologtostderr=false; --colorlogtostderr=false; --drop_log_memory=true; --log_backtrace_at=; --log_dir=; --log_link=; --log_prefix=true; --logbuflevel=0; --logbufsecs=30; --logemaillevel=999; --logfile_mode=436; --logmailer=/bin/mail; --logtostderr=true; --max_log_size=1800; --minloglevel=0; --stderrthreshold=2; --stop_logging_if_full_disk=false; --symbolize_stacktrace=true; --v=0; --vmodule=; \n",
            "I0221 16:16:15.739552 10328 Test.cpp:136] Number of classes (network): 8065\n",
            "I0221 16:16:15.739646 10328 Test.cpp:143] Number of words: 2\n",
            "I0221 16:16:15.744534 10328 Test.cpp:205] [Dataset] Dataset loaded, with 6 samples.\n",
            "HERE!!!\n",
            "|T|: \n",
            "|P|: A s I a p p r o a c h | t h e | c i t y | I h e r d | b e l l s r i n n y | l a t e r | I | f o u n d | t h e | s t r e e t s | o | s t i r | w i t h | t h r o n g s | o f | w e l l - d r e s s e d | p e o p l e | i n | f a m i l y | g r o u p s , | w i n d i n g | t h e i r | w a y | h e i t h e r - e n d e t h e r .\n",
            "[sample: 0, WER: inf%, TER: inf%, total WER: inf%, total TER: inf%, progress (thread 0): 16.6667%]\n",
            "HERE!!!\n",
            "|T|: \n",
            "|P|: H e | m u s t | h a v e | r e a l i z e d | I | w a s | a | s t r a n g e r | a n d | w i s h e d | y o u | t i n d e r | h i s | h o s p i t a l i t y | t o | m e ; | I | a c c e p t e d | i t | g r a t e f u l l y , | I | c l a s p d | h i s | h a n d , | h e | p r e s s e d | m i n e .\n",
            "[sample: 4, WER: inf%, TER: inf%, total WER: inf%, total TER: inf%, progress (thread 0): 33.3333%]\n",
            "HERE!!!\n",
            "|T|: \n",
            "|P|: L o o k i n g | a b o u t | m e , | I | s a w | g e n t l e m a n | i n | a | n e a t | b l a c k | d r e s s , | s m i l i n g , | a n d | h i s | h a n d | e x t e n d e d | t o | m e | w i t h | g r e a t | c o r d i a l i t y .\n",
            "[sample: 2, WER: inf%, TER: inf%, total WER: inf%, total TER: inf%, progress (thread 0): 50%]\n",
            "HERE!!!\n",
            "|T|: \n",
            "|P|: D i e | S p r a c h e | i s t | d a s | H a u s | d e s | D S i g n s , | L a n g u a g e | i s | t h e | H o u s e | o f | B e i n g .\n",
            "[sample: 5, WER: inf%, TER: inf%, total WER: inf%, total TER: inf%, progress (thread 0): 66.6667%]\n",
            "HERE!!!\n",
            "|T|: \n",
            "|P|: O f | c o u r s e | y o u | a r e | g o i n g | t h e r e , | t o , | I | s a i d | i | m y | f r i e n d l y | g o d . \"\n",
            "[sample: 1, WER: inf%, TER: inf%, total WER: inf%, total TER: inf%, progress (thread 0): 83.3333%]\n",
            "HERE!!!\n",
            "|T|: \n",
            "|P|: \" W e | g a i z e d | f o u r | m o m e n t s | s l i g h t l y | i n t o | e a c h | o t h e r ' | s e y e . \"\n",
            "[sample: 3, WER: inf%, TER: inf%, total WER: inf%, total TER: inf%, progress (thread 0): 100%]\n",
            "I0221 16:17:49.017895 10328 Test.cpp:434] ------\n",
            "I0221 16:17:49.017944 10328 Test.cpp:435] [Test audio.lst (6 samples) in 93.2733s (actual decoding time 15.5s/sample) -- WER: inf%, TER: inf%]\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        ""
      ],
      "metadata": {
        "id": "NK5FoaRjPOd2"
      },
      "execution_count": 11,
      "outputs": []
    }
  ]
}
